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PREFACE 


Sarva Shiksha Abhiyan (SSA), a flagship programme of the Government of India, provides a variety of inputs 
designed to ensure access, equity and quality in elementary education. As concerted efforts are made to achieve the 
objectives of SSA, it becomes important to gather information about what the children in schools know and can 
do at different stages of elementary education. In other words, an accurate measure of the learning achievement 
of children at different stages of education can provide important insights as to whether the inputs made into the 
elementary education system had a beneficial effect or not. Such evidence is provided by the National Achievement 
Surveys (NAS) carried out by NCERT every three years. This series of surveys not only provides policy makers, 
planners, curriculum developers and other practitioners with a ‘snapshot’ of what students have learnt in main 


subjects, but also provides a baseline against which changes in educational standards can be monitored. 


[he present survey is the third cycle of Class V in which the children’s learning achievement has been measured in 
Language, Mathematics and Environmental Studies. This report is based on the data collected through standardized 
achievement tests administered to 122,543 students and through questionnaires from 6602 schools, 10851 teachers 


and 117,653 students from 31 States and Union Territories of the country. 


This survey differs from those conducted previously in several important aspects. Most importantly, in this survey 
student responses to questions in the tests were analysed using modern Item Response Theory (IRT) rather than the 
classical techniques used in earlier surveys. As a result, all the scores in this report are located on standardised scales 


from 


0-500. (Scores on earlier surveys were reported simply as the percentage of correct answers— a value which varies 
according to the tests takers.) This practice is consistent with that of major international surveys such as the 
Programme for International Student Assessment (PISA), Progress in International Reading Literacy Study (PIRLS) 
and Trends in International Mathematics and Science Studies (TIMSS). 


This report presents the national picture of Class V students’ learning achievement in three subject areas: Language 
(Reading Comprehension); Mathematics; and Environmental Studies (EVS). For each subject, findings are reported 
in two complementary chapters. The first summarises achievement results for the participating states and UTs. The 
second describes what students at different levels of achievement know and can do in that particular subject based 


on evidence from the test results. 


In addition to measuring student achievement in main curricular areas, questionnaires were administered to 
students, teachers and school principals to collect information about a wide range of background variables that may 
have impact on learning. The data collected is summarised in this report giving an objective overview of the present 
situation. This information, together with the student results database, will be shared with states so that they can, 
in collaboration with NCERT, prepare state-specific reports and conduct further analysis for the benefit of states. 


In conducting such surveys, the quality of data is of paramount importance. All efforts, therefore, have been made by 
the Department of Educational Measurement and Evaluation, NCERT to ensure quality in data collection, analysis 
and reporting. The Department has benefitted from the continuous support of the Technical Support Agency (TSA). 
The agency has helped us to improve the study and, as a result, has allowed us to report on student achievement 


following international patterns. I am grateful for the valuable inputs provided by TSA's team at NCERT and its 


international consultants. 


Prof, Krishna Kumar, former Director, NCERT has been a great source of inspiration to accomplish this gigantic 
task. Lam grateful for his guidance and contribution. My thanks are also due to MHRD particularly Ms Anita Kaul, 


Additional Secretary for providing both financial and administrative support. I also acknowledge the support of 
NUEPA for providing DISE data. 


The present study could not have been completed without the active participation of State Councils of Educational 
Research and Training (SCERTS) and other state agencies SCERTs, DTERTs, SIEs, Directorates of Education, School 
Education Boards, etc. The Directors and other associated staff from these organizations are to be complimented for 
completing the arduous task of administering tools in time. 


I thank Dr Santosh Kumar, Coordinator of the survey, and members of the project team who worked hard in 


analysing and interpreting the data, and preparing the report in time. I also thank other project staff for their support. 


Finally I thank one and all who have contributed to this study in some or other way. I earnestly hope that it will be 


useful to policy makers, planners, researchers and all others in raising the quality of elementary education in India. 


Avtar Singh 

Professor and Head 

New Delhi Department of Educational Measurement and Evaluation 
April, 2012 


National Council of Educational Research and Training 


EKECUTIVE SUMMARY 


Introduction 


‘ational Achievement Surveys (NAS) are conducted under the Government flagship programme Sarva Shiksha 
\bhiyan (SSA). NAS is designed to provide information about the learning achievement of students in the elementary 
ctor of education in government and government-aided schools. This is achieved by administering standardized 
sts to students of Classes III, V and VIII. NAS also collects information about relevant background factors related 
| the school environment, instructional practices, the home backgrounds of students, teachers’ qualification etc. 
AS data gives policy makers, curriculum specialists, researchers and other stake holders a ‘snapshot’ of what students 
now and can do in key subjects at a particular point in time. The results also serve as a baseline against which future 
rogress in education may be evaluated. 


Ihis report presents the findings of the third cycle of the national achievement survey of students studying in 
Class V conducted from November 2010 to March 2011. The subjects covered were Language (including Reading 
Comprehension), Mathematics, and Environmental Studies (EVS). 


Methodology 


Sample selection 


Selecting a representative sample in India is a challenging yet critical part of the survey process. For Class V NAS, 
government and government-aided schools having Class V were included in the sample frame. The general selection 


procedure was: 
W Selection of districts within a state (Probability Proportional to Size (PPS) sampling) 
m Selection of schools (PPS within each selected district) 


W Selection of students (randomly within selected schools) 


This survey saw tests and questionnaires administered to a sample of 1,22,543 students, and 10851 teachers from 
6,602 schools across 27 States and 4 Union Territories. 


Tool development 


For any large survey, the tools employed need to be accessible, valid and reliable. In order to measure reliably 
the achievement levels of class V students, tests in three subjects, viz. Language, Mathematics and Environmental 
Studies (EVS) were developed. In view of the wide variation in course content across the states, developing suitable 
tests was big challenge. The first step was to collect the syllabuses and the text books of Language, Mathematics 
and Environmental Studies from the states/UTs. These were then analysed from the point of view of the content 
areas covered and the competencies to be developed. In each subject, common core content and competencies 
were identified. Based on this analysis, subject-specific assessment frameworks were developed. ‘These described the 
content areas and competencies to be covered and prescribed the number and type of items to be used for testing 
each domain. In order to provide sufficient information, three test forms were developed for each subject. For the 
Class V NAS, each test for EVS and Mathematics consisted of 40 multiple-choice items. Of these, 20 were common 


‘anchor items’ which appeared in all test forms. Thus, overall 80 unique items were used in each subject to measure 
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learning achievement. Each Language test form consisted of 35 multiple-choice items with 20 serving as anchor 
items. Texts and items testing reading comprehension were used in direct translation in all states and UTs. Items 
testing language elements such as grammar were developed specifically for each language and were not used in 


translation. Finally, scoring keys were developed and checked for each test form in each subject. 


Translation workshops were conducted in which invited experts translated the tests into 15 languages. Checks were 
undertaken to see that each item tallied with the items in the master tests in English. In this way, multiple test forms 
in Language, Mathematics and EVS were finalised in 15 languages for administration across the different states/UTs 
of India. 


Test administration 


NAS is conducted by the National Council of Educational Research and Training (NCERT). To coordinate the NAS 
project in the States/ UTs, NCERT takes the help of state agencies — notably SCERTs and SIEs. For the current 
survey, each participating state designated a State Coordinator who was responsible for implementing the NAS in 
their State/UT in accordance with NAS guidelines. State coordinators were given training on how to collect data 
in the field. For this a detailed training manual was developed by DEME. Thereafter, State Coordinators provided 
training to district coordinators about the conduct of main achievement survey. In each selected district, district 
coordinators appointed 10 to 12 teams of field investigators. Each team comprised two field investigators. They were 
given a rigorous training about selection of sections and students in the sampled schools, administration of tools 
and transfer of responses from test booklets to separate response sheets. These response sheets were collected by the 
district coordinators and then sent to the state coordinator after checking. These response sheets were dispatched by 
the state coordinator to the NCERT where they were scored and analyzed. State Coordinators and their teams are to 
be commended for their efforts. Without their help and professionalism, the massive task of data collection for the 
National Achievement Survey would not have been possible. 


Use of IRT 


In earlier two cycles of surveys, the data was analysed using Classical Test Theory (CTT) and average scores were 
reported as the ‘proportion of answers correct’. However, this approach has significant limitations. To overcome 
these, data from the present Survey was analysed using Item Response Theory (IRT) in addition to the classical 
approach as is the practice of major international surveys. IRT uses a mathematical model to link a student’s chance 
of success on a particular item to two main factors: the student’s level of ability and the item’s level of difficulty. In 
this model, the difficulty of an item does not depend on the group of test takers. This allows the use of multiple test 
booklets which can be linked. It also allows scores from tests used in different cycles to be compared - an essential 
characteristic for monitoring progress over time. 


Throughout this report, results are reported using ‘scale scores’ calculated using IRT in place of the percentage 
correct scores. For this, the chosen scale is from 0 to 500. The average score for the whole population is initially set at 
250. The standard deviation of the scale is initially set at 50 for the whole population. This means that the majority 
of students (about 70%) will have scores in the range 200 to 300. (See figure below.) 
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This executive summary presents the major findings of the survey about the achievement of Class V students in 
Language, Mathematics, and EVS. Selected background characteristics of schools, teachers and students are also 


reported. Regression analysis was used to see the impact of these background variables on student achievement. 


Achievement in Language (Reading Comprehension) 


The average Reading Comprehension achievement of students varied greatly across the states and UTs of India. 
[here was a highly significant difference between outcomes in high scoring states such as Uttar Pradesh (282), Tamil 
Nadu (278) and Kerala (277), and low scoring states/UTs such as Puducherry (222), Bihar (228) and Chhattisgarh 
(229). 


States also varied greatly in the range between their lowest and highest achieving students as revealed by their inter- 
quartile score ranges. Some States/UTs, e.g. Puducherry (39), Sikkim (44) and A & N Islands (51) had relatively 
homogeneous cohorts whilst in others students demonstrated far more diverse abilities e.g. Uttar Pradesh (93), Tamil 


Nadu (85) and Jharkhand (81). 


Overall, no significant differences were detected in the average achievement of girls and boys. Similarly, no significant 
difference was detected between the achievement level of rural and urban students although exceptions were found 
in a small number of States/UTs. The survey did find that students from the General category outperformed their 
peers in the SC, ST and OBC categories by a statistically significant margin. 


What Class V students know and can do in Reading Comprehension 


In reading comprehension three cognitive processes were identified: locating information; grasping ideas and 
interpreting them; and, inferring and evaluating. Across this domain of Reading Comprehension, Class V students 


demonstrated a wide range of ability. 


Students at the lower end of the scale (i.e. within 200 to 240 scale scores) could demonstrate all three cognitive 
processes — provided that the context was clear and the tasks non-complex. For example, they were able to use 
information from a table, to locate the time and the occurrence of a phenomenon, recognize a particular text type, 


and also make simple inferences. 


Students performing in the intermediate range of the scale (say, 240 to 275 scale score) could do more. They could 
determine the causes, frequency, duration and sequence of events described in a variety of texts. They could also 
identify cause and effect relationships and make complex inferences about the qualities of characters from their 


actions. 


Students performing at higher end of the scale (i.e. those with scale scores above 275) could do more. In addition, 
they could identify the main theme of a given passage. They could also identify the relationship between events, ideas 


and phenomena, and recognize the likely thoughts of characters in the text. 


It was also seen what the majority of students could do in Reading Comprehension. On an average about half of the 
students could locate information from the given text, make inference about the cause of an act or event and were 
able to draw simple conclusion about the usefulness of an object. More than 60% students in the country could 
gather information from a given table about a particular event and could recognize the text type as a notice. On the 


other hand only one third of students were able to identify the main theme and evaluate the title of a given passage. 
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Achievement in Mathematics 


The results show that the average mathematical achievement of students varied greatly across the states and UTs. 
Great differences were observed in outcomes in the group of high scoring states such as Uttar Pradesh (298) Tamil 
Nadu (279) and Karnataka (269) and the low scoring states/UTs such as Puducherry (217), Andaman & Nicobar 
Islands (226) and Chandigarh (226). 


States also varied greatly in the range between their lowest and highest achieving students as revealed by their inter- 
quartile score ranges. Some states/UTs, e.g. Chandigarh (36), Andaman & Nicobar Islands (37) and Puducherry 
(40) had relatively homogeneous cohorts whilst others had students far more diverse in achievement e.g. Uttar 


Pradesh (85), Tamil Nadu (84) and Karnataka (81). 


Overall, no significant difference was found in the average achievement of girls and boys in Mathematics. Some 
readers may be surprised by this finding. However, the large sample size (>55,000) and the consistency of this finding 
across states suggest that this is a robust conclusion. Similarly, with a few exceptions, no significant difference was 
detected between the average achievement level in Mathematics of rural and urban students. Data from the survey 
indicated that students from the General category outperformed their peers in the SC, ST and OBC categories by a 
statistically significant margin. 


What Class V students know and can do in Mathematics 
Class V students demonstrated a wide range of abilities in the domain of Mathematics. 


Students performing at the lower end of the ability scale, (i.e. within the range 175 to 230 scale scores) could 
demonstrate basic mathematical knowledge e.g. they knew the place value of digits in the number system and could 
recognise geometrical shapes. They could also apply fundamental concepts and perform basic operations in simple 
situations. 


Students performing in the intermediate range (i.e. those with scale scores of, say, 230 to 275) could do more. They 
could perform a wider range of mathematical operations including multiplication and division; work competently 
with basic units; and, apply their knowledge to a range of problems set in authentic contexts (e.g. money calculations 
in the market) provided that the context was clear. 


Students performing at higher end of the scale, (i.e. those with scale scores above, say, 275) could do still more. 
In addition, they could apply most or all of the mathematical operations required by the curriculum; demonstrate 
understanding of fractions; add decimal fractions; work confidently in a range of units including those of area; and 
solve more complex problems involving time and money calculations - even when these were set in less familiar 
contexts. 


In order to find out what majority of students could do in different areas of Mathematics, the percentage correct 
on each item was calculated. It was seen that more than 70% students could count the sides of a given figure and 
identify the largest angle among the given angles in a geometrical figure. About 60% of students could solve simple 
problems of basic operations and measurement and could find out the multiplier of a given numbers. However, only 


one third of students could compute the difference between two decimal numbers and only 22% students could do 
word problems based on memory. 
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Achievement in Environmental Studies 


he average achievement of Class V students in Environmental Studies varied greatly across the participating states 
id UTs. Highly significant differences were seen between outcomes in high scoring states such as Tamil Nadu 
88), Uttar Pradesh (284) and Karnataka (275) and low scoring states/UTs such as Puducherry (222), Chandigarh 
26) and Haryana (232). 


ter-quartile score ranges also varied greatly across the states. Some states/UTs, e.g. Chandigarh (38), Puducherry 
3) and Sikkim (44), had relatively homogeneous group of students in terms of ability whilst others showed far 
re diversity e.g. Uttar Pradesh (89), Karnataka (84) and Madhya Pradesh (83). 


verall no significant differences were detected in the average achievement of girls and boys. Similarly, no significant 
{ference was detected between the achievement level of rural and urban students although exceptions were found 
: a small number of states/UTs. The survey did show that, as in the other subjects tested, students from the General 


:tegory outperformed their peers in the SC, ST and OBC categories by a statistically significant margin. 


What Class V students know and can do in Environmental Studies 


The items of the EVS test booklets were designed to assess three cognitive processes or ‘skills’: knowing, applying, 


and reasoning. 


From the EVS item map it was seen that students at the lower end of the scale (say, 170 to 225) could demonstrate, 
albeit to a limited extent, all three cognitive processes. For example, they could use information from a table and 


locate places and directions on a map. They could also classify animals and plants on the basis of their characteristics. 


Students performing in the intermediate range of ability (say, scores of 225 to 275) could do more. They could 
analyze issues, interpret information, establish relationships, relate information, and find solutions in different 


situations. They could also identify cause and effect relationships and make inferences in various situations. 


Students performing at higher end of the scale (i.e. those with scores above 275) could do more. In addition, they 
could explain the components of diet and their functions, identify sources of energy and their by products, and 
demonstrate understanding of the importance of the natural environment to human life. They could also explain 


observed phenomena in terms of physical processes. 


It was found that in the cognitive process of ‘knowing’, more than three-quarters of students could identify the name 
of flightless birds and knew about amphibians and the spread of disease by mosquitoes. 


In the process of ‘applying’ about 75% students could classify the animals into groups identify the footprints of birds, 
work out that salt can dissolve in water and about 60% understood that motor driven vehicles caused pollution. 


Only one third of students knew about the source of energy which produces carbon dioxide. 


In the process of ‘reasoning’ nearly three-quarters of students could interpret a given weather graph and more than 
50% could reason out that paint dissolves in kerosene, why the Earth looks blue from the outer space and that 


overpopulation is the main cause of unemployment and housing problems in India. However, only one third of 


students could explain the benefits of forests. 


School-related Variables 


The survey collected information about the school environment in four categories - School Background, Home- 


School Interaction, Teaching Learning Process, and School Social Climate. 


School Background 


Overall, approximately 70% of the schools surveyed were managed by State Governments, 83% were rural, 67% had 
a pre-school attached, 68% schools were inspected, and 73% followed a six-day week. However, in these as in other 


variables, there was wide variation amongst the states and UTs surveyed. 


The majority of schools reported having no or few vacancies to fill. In states such as Punjab, Orissa, Jammu and 


Kashmir, and Assam, there were more vacancies and schools found these difficult to fill. 


In the vast majority of the schools sampled, basic facilities such as playgrounds and safe drinking water are in place. 
Similarly, basic teaching materials and library books are available in more than 90% of schools. However, computers 


and musical instruments are less common being available in about 50% of schools only. 


‘The survey showed that the mid-day meal scheme was functioning in more than 90% of schools, free uniform in 
about 50% of schools, and the free textbooks scheme in 95% of schools for students of all social categories. 


Home-school Interaction 


The Home-school interaction category represented those variables which were jointly influenced by both home and 
school factors. Overall, more than 90% of the schools asked parent to attend special events, to ensure that the child 
completed his/her homework, and to serve on school committee but only 49% of schools asked parent to raise funds 
for the school. About 40% schools rated parents’ support as medium. 


‘The participation of the Village Education Committee (VEC) and the Parent Teacher Association (PTA) were 
available in majority of the schools (95% and 82% respectively). 


More than 50% of the schools rated teachers’ job satisfaction, teachers’ understanding of the curricular goals, 
teachers’ degree of success in implementing the curricula and teachers’ expectation of student achievement as high. 
Also 47% of the schools rated student desire to do well as high. 


Teaching Learning Process 


Grouping of classes and availability of various kinds of instructional materials were considered under this variable, 
It was found that in more than 78% of the schools, the students’ were grouped on the basis of ability in EVS and in 
Mathematics and that the level of achievement was significantly higher in such schools. 


In about 85% of the schools enrichment as well as a remedial programmes in EVS and in Mathematics were in place. 
Such programmes were found to have a positive effect on the achievement of the schools. 


The survey also disclosed that 99% of the schools had textbooks in all the subjects, and more than 80% had 
workbooks and teacher handbooks available, Teaching learning material was available in more than 96% of the 
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sampled schools. All these had positive impact on the learning of different subjects. However, science laboratory, 
access to internet, and ICT facilities were not available in more than 70% schools. 


Social Climate of School 


School climate influences the behaviour of both teachers and students. Under this, behavioural problems of students 
were studied. The analysis revealed that overall the social climate in schools was good as very few schools reported 
any problematic behaviours by students. For example, late arrival to school in 66% and absenteeism in 59% schools 
was rarely seen. Skipping classes, indulging in cheating, and disturbing the classroom decorum were never observed 
in 53% to 64% of the schools. Students using profanity, indulgence in vandalism and activities of theft were never 
observed 68% to 77% schools. Causing physical injuries to other students was never observed in 60% of the schools 
and intimidation/verbal abuse or physical injuries to teachers were never experienced by majority of schools (more 
than 88%). 


When the impact of school variables was seen on student achievement, it was found at that the factors like equipment, 
school governance, availability of help in ICT schools having more middle income group students, schools which 
involve parents, pupil desire to do well etc., have a positive effect on attainment whereas internet access, attachment 
of pre school with the main school, problem behaviour of students and schools having more disadvantage students 


have shown negative impact. 


Students -related Variables 


Student Background 


Overall 49% boys and 51% girls participated in this survey. About 66% students were 10-11 years old. From 
among the sampled students there were 21% SC, 17% ST, 34% OBC and 25% other categories students. Nearly 
70% students spoke the same language at home as the one used in the school as medium of instruction. On an 
average nearly half of the students had three or more siblings. In this survey only 6% students belonged to physically 


challenged group. 


Parents of about 2/3rd students had the educational status from literate/primary to higher secondary. Nearly 1/3rd 
students reported that their parents were agricultural labourer/daily wagers or street vendor. Further, it was found 
that in the sampled schools nearly half of the students belonged to below poverty line families, i.e. BPL card holders. 
It was also observed that the students belonging to BPL card holder families could not do as well as the other 
students in all the three subjects. The data indicated that the educational status of parents had positive impact on 


their wards’ achievement. 


Availability of Resources at Home 


The survey showed that less than half (30% - 47%) students had literary resources such as daily newspaper, dictionary, 
calculator, books other than course books and study desk available at home. 


About 60% students received help from their family members and 44% from their tutor. Approximately, 30% 
students took private tuitions. The highest percentage of students taking tuitions (83%) was seen in West Bengal. 
Almost all the students (97%) reported having textbooks for all three subjects. 


Availability of Educational Resources at School 
As far as the availability of educational resources is concerned, 44% students reported that computers were available 
in their schools but 55% students said they never used the computers. Similarly, availability of library in the school 


did not ensure that the students would use the library. For example in Sikkim 71% students reported that their 


schools had library but 61% said that they never used it. 


Teaching Learning Process 


Students reported about the frequency of home work in different subjects. On an average in Language 72 %, in 
Mathematics 44%, and in EVS only 57% students reported that they were given homework daily. 


The largest percentage of students (56%) reported liking language as a subject followed by Mathematics (30%) and 
EVS (14%). Almost 90 % students liked to be in school. 


Activities Outside School 

For the overall development of students, activities outside the school are important. When asked about various 
activities it was found that nearly 67% students watched TV, 79% interacted with their friends, and 83% played 
games/sports, 82% did the homework given at school and 33% read books for enjoyment. Further 71% students 


reported that they looked after their family members, 63% helped in cleaning the house and 33% helped in preparing 
food daily. 


Teacher-related Variables 


In this survey information was collected from the teachers under four heads — teacher background, teacher training, 
teaching learning process, and teachers’ opinion about the school. 


Teacher Background 


A total of 10851 teachers filled the Teacher Questionnaire. Out of these, there were 55% male and 45% female 


teachers. In contrast to this in Delhi the female teachers were 86% while male teachers were only 14%, Majority of 


the teachers were between 31 to 51 years of age. Most of the teachers, i.e. 63% were graduates or post graduates, 23 
% qualified at higher secondary and only 13% teachers were qualified at secondary level or below. About two third 


of the teachers in Chandigarh were postgraduates whereas in Gujarat 54% teachers were qualified only at the middle 
level. 


Overall 79% teachers were regular teachers and 12 % were para teachers in the surveyed schools. But in Chhattisgarh 


the percentage of para teachers was 82 %. 


Teacher Training 


65% teachers were primary/elementary teaching certificate or diploma holders. There was a lot of variation among 
the states regarding the professional qualification of the teachers. Highest number of teachers with master’s degree in 
professional qualifications were in Jammu and Kashmir state, 
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Of the sampled teachers, 82% had attended 1-5 in-service training programmes. However, in Haryana and 
Meghalaya around 50 % Teachers had not attended any in-service training program. In most of the states maximum 
training programs were organized by school complex, CRC and BRC. In Meghalaya DIET/DRC were more active 
in providing in service training programs. 


Teaching Learning Process 


Among the sampled teachers, 85% teachers gave homework regularly. Besides, it was seen that 83 % teachers 
maintained Teachers Diary to keep a record of their day to day activities planned and executed in the class. Such a 
record helps teachers as well as supervisors to know what teachers did on a particular day in a period in a class. 


As far as Teaching Support Material is concerned, it was found that 84% teachers had Teacher's Handbook, 93% 
teachers had TLM, 39% teachers had Audio-Video facilities and 75% had received TLM Grant. In Kerala and 
Daman & Diu all teachers had Teaching Learning Material. In Andhra Pradesh, Haryana and Kerala Audio-Video 
facilities were available to less than 3% teachers. Overall 41 % teachers reported that they had received the academic 
support 1-5 times in the academic year 2009-2010. 


Regarding teacher interaction with each other, it was found that more than 40% teachers interacted with each other 
2-3 times a week regarding how to teach a particular concept or preparation of instructional material and also visited 
another teachers classroom to observe his/her teaching 1-3 times per week. 


When asked about the problems in schools, more than 65% teachers in West Bengal responded that overcrowded 
classes were a serious problem. Overall only 15% teachers reported not having adequate workspace outside their 
classroom as a serious problem. 50% teachers considered non-availability of materials for conducting experiments 


as a minor problem. 


In order to know the status of revised text books on the basis of National Curriculum Framework (NCF)-2005 in 
the states, the teachers were asked whether they used the revised text books based on the NCF-2005 for Class V. 
Their responses indicated those revised textbooks based on NCF-2005 were being used by almost all the teachers in 
Language, Mathematics and Environmental Studies (EVS). 


Overall 38% teachers had attended a training programme based on NCF-2005. In Uttarakhand 75% teachers had 
attended NCF-2005 based training programmes and in Jharkhand, Maharashtra and Uttar Pradesh nearly 62% 
teachers attended the training programmes based on NCF-2005. 


Teachers’ Opinion about School-related Factors 


Teachers opinions were sought on various school related factors. More than 50% teachers reported that the teachers 
were highly satisfied with their job, teachers’ degree of success in implementing curriculum was high, and that 
students wanted to do well in their schools. 47% teachers reported the teacher's expectations from their students, and 
students’ regard for school property was high. However, more than 40% teachers reported that the parental support 


and their involvement in school activities were low. 


Regression Analysis: Summary of Findings 


The table which follows summarises the outcomes of the regression analyses described in chapters 8, 9 and 10. The 
factors listed appear to have a robust effect on attainment in different subjects in the sense that the relationship is 
statistically significant and is not extinguished by allowing for key variables including home resources and speaking 


the language of instruction at home. 


Student-related factors School-related factors Teacher-related factors 


Factors associated with a Having a subject textbook Equipment Years of teaching at the current 
positive effect on attainment | Positive attitude to learning School governance school 


| 
Help in studies Student:computer ratio Keeping teacher's diary | 
Homework checked at school | Help in ICT Range of activities in the 
Homework checked at home | Middle income classroom | 
Reading out of school School involves parents Teacher's handbook | 
Watching V Pupils desire to do well Audio-Visual facilities 
Hanging out with friends Teacher peer review. 
Discussing school at home 
Mode of transport to school 

Factors associated with Number of siblings Disadvantaged pupils Para teachers, shiksha karmi, 

a negative effect on Being physically challenged Problem behaviour etc. 

attainment Working with the computer Pre-school attached Severe problems with facilities 

Internet access Receipt of TLM grant 


Limitations 


This survey undoubtedly represents a significant step forward in the development of national achievement surveys in 
India. However, as with all such enterprises, lessons have been learnt. In conducting the Class V NAS, the following 


limitations have been noted so that they may be addressed in future achievement surveys: 


m The survey used DISE 2007-08 data from the National University of Educational Planning and Administration 
(NUEPA) as the primary sample frame. Once in the field, significant discrepancies between the DISE data and 


actual school enrolments were noticed. 


m In some states, sampled schools were changed by the state personnel because of disturbances in states due to 


various reasons. Hence, the data collected in such states may not be as representative as initially planned. 


W Due to discrepancies in the sample frame, deviation from agreed sampling procedures, and loss of information 
during administration, it was not possible to estimate sample weights for the survey. 


m In the states of Jharkhand, Meghalaya, Mizoram, Nagaland, Sikkim and West Bengal, the tests had to be 
administered at the beginning of class VI rather than at the end of class V due to administrative reasons. 


W In most of the states, responsibility for data collection was given to DIET faculty who, in turn, used their 
students as field investigators. On reflection, the training and hands-on practice given to these field investigators 
may not have been sufficient resulting in inefficiencies in the data collection procedure and, hence, increased 


demands during the data cleaning process. 


m In order to meet the key objectives of this survey, schools and students were sampled in a systematic fashion. This 
meant that teachers could not be explicitly sampled in the same way. As a result, the analysis of teacher-related 
variables vis-à-vis student attainment could not be made in a comprehensive manner. 


m In past surveys, the CTT model was used for developing tests and analysing the results. In this survey, IRT 
was used. These two methodologies are quite different. Therefore, the results of this survey are not directly 
comparable with those of past surveys. 


m For the first time, NCERT used IRT for analysis of results instead of CTT. Therefore, results are reported in 
terms of scale scores rather than percentage correct scores. Whilst this is an important step towards emulating 
international best practice, unfamiliarity with this approach has undoubtedly made it more difficult for the 
lay reader to interpret results. It is hoped that as IRT becomes more widely used in India, understanding will 


improve. 


Chapter 1 


Introd uction 


CHAPTER 1 INTRODUCTION 


This report summarises the findings of the National Achievement Survey (NAS) of class V students conducted in 2010 
by the National Council for Educational Research and Training (NCERT) through its Department of Educational 
Measurement and Evaluation (DEME). It is based on information gathered through tests and questionnaires 
administered to a sample comprising 1,22,543 students in 6,602 schools across 31 States and Union Territories 


(UTs). The subjects covered were Mathematics, Language (including Reading Comprehension) and Environmental 
Studies (EVS). 


‘This survey is the latest in an ongoing programme of such studies available to all 35 States and UTs of the nation. 
Ihe aim of each NAS is to provide reliable information on the achievement of students in the elementary sector of 
education in government and government-aided schools. This is achieved not only by applying standardised tests 
‘o students, but also collecting information about relevant background factors including the school environment, 
instructional practices, qualification and experience of teachers, and the home background of students. The data 
from each NAS gives policy makers, curriculum specialists, researchers and, most importantly, school principals 
and teachers a ‘snapshot’ of what students are achieving in key subjects at a particular point in time. By repeating 
such measurements at regular intervals, trends can be explored providing an invaluable perspective from which to 
consider educational reform and improvement. 


It should be noted that whilst each NAS provides achievement scores for the nation, for each participating state 
and for certain groups (e.g. females, students in rural schools, etc.), it does not give scores to individual students or 
schools. 


1.1 History of NAS in India 


in the year 2000, the programme of NAS, originally conceived by NCERT as an independent project, was incorporated 
‘nto the Government’ flagship project Sarva Shiksha Abhiyan (SSA). NCERT is responsible for developing and 
conducting the surveys whilst funding is provided by the Ministry of Human Resource Development (MHRD). 


Under SSA, three cycles of NAS were planned. Each cycle was to cover three key grades: class III, class V and class 
VII/VIII. The first cycle conducted in the period 2001-04 was named the Baseline Achievement Survey (BAS). The 
second cycle, conducted during 2005-08 was the Mid-term Achievement Survey (MAS). The third planned cycle 
was originally named the Terminal Achievement Survey (TAS). However, the importance of these surveys and the 
experience gained through the first two cycles made it clear that this programme should be an ongoing feature of 
the national education system. Therefore, the current series of NAS is more correctly known as ‘Cycle 3’ as given in 
the Table 1.1 below: 


2001 | 2002 [ 2003 | 200 [ 2005 | 2006 | 2007 | 2008 | 2009 | zo | 20m | zw | 


(formerly BAS) (formerly MAS) (NAS) 
[swam | | [| [| cassmavn | | osm [| | 


* The findings of the Cycle 3, Class V (NAS) are reported herein. **Cycle 3 (NAS) for Class VIII is in progress while Class III has been initiated. 


National Achievement Survey 


At the class III level, assessment is made in two subjects, i.e., Mathematics and Language. For class V, assessment 
is carried in three subjects: Mathematics, Language and EVS. For class VII/VIII, four subjects are assessed, i.e., 


Mathematics, Language, Science and Social Science. 


The comprehensiveness and coverage of these surveys provide very useful data to capture the progress of the education 


system as well as to enhance the quality of elementary education. 


The survey reported herein represented a quantum leap forward in the methods used to analyse the results. NCERT's 
belief that these surveys should be an ongoing feature of the national education system encouraged the project to 
introduce a new method of scoring the test results, namely Item Response Theory (IRT) (see 1.9 below). This offers 
the exciting possibility of linking and thus comparing national and state test scores over time, even though different 
tests are used. This requires a survey design which specifies some repetition of items between the tests to be linked, 
and that sampling and weighting details should be comparable. IRT methods are described in more mathematical 


detail in Appendix II. 


1.2 Development of Tools 


For any large survey, the tools employed need to be simple, understandable, valid and reliable. For measuring reliably 
the learning levels of class EVS are important. The tests need to be pegged at the level that they measure the abilities 
developed in children across the states. In view of variation in course content and other factors, developing tests is 
a big challenge. Therefore, before undertaking the test development, it was necessary to know what was taught at 
class V level by different states in different subjects. The first exercise, hence, was to collect the syllabuses and the 
textbooks of Language, Mathematics and EVS from the states/UTs. These were then analysed from the point of 
view of the content areas covered and competencies acquired. The common core content and competencies were 


identified for developing the tests. 


Based on the analysis, assessment frameworks were developed in each subject. The frameworks described the 
competencies to be covered in the tests, the number and type of items to be used for testing each competency, the 
structure of the test forms and number of tests forms to be used. 


For measuring each learning outcome with sufficient precision, it was necessary to construct multiple test forms in 
each subject. A three dimensional grid was prepared in each subject indicating the content areas to be covered, skills 
to be tested, the difficulty level of items under each skill along with the number of items. 


Item writing workshop 
General 


The item writing workshop included plenary sessions on fundamental principles of test development and subject- 
specific workshops for writing and reviewing/editing draft items. 


‘The general principles covered were: 
m Characteristics of sample-based achievement surveys (national and international) 
W Test specifications and their role in test development 


m Item writing rules and guidelines 
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Procedures and checklists for reviewing the quality of items 


Introduction to classical item statistics. 


1.2.1 Language 


[here were two sub-groups — English and Hindi. The work was guided by the draft specifications for the language 


test prepared by DEME, text and item types from MAS and international examples from various sources including 


National Assessment of Educational Progress (NAEP) reading. The tasks covered were: 


Reading texts and questions (4-option mcq) 
Error correction (3-option mcq) 
Discrete items on language structures’ (4-option mcq) 


Writing tasks and scoring criteria 


the Hindi group checked that the English reading passages could be translated. They also produced an original 


Hindi reading passage for translation into English. 


Sufficient passages, discrete items and writing tasks were prepared and reviewed to create three booklets for pre- 


cesting having the following structures: 


Booklet 2 

Reading passage 4 (New) 
Reading passage 5 (New) 
Reading passage 6 (New) 
language structure block 6 
(5 items) 

Language structure block 7 
(5 items) 

Language structure block 8 
(5 items) 

Language structure block 9 
(5 items) 

Language structure block 9 
(5 items) 


Language structure block 1 
(5 items) 
Language structure block 2 
(5 items) 
Language structure block 3 
(5 items) 


Language structure block 4 
(5 items) 
Language structure block 5 
(5 items) 


Language structure block 13 
(5 items) 


The next steps undertaken were: 


Entering all items, reading passages, marking keys etc. into the computer and checking. 

Preparing artwork for reading passages. 

Translating English reading tasks to Hindi and vice versa. 

Selecting the passages and items for three booklets for pre-testing. 

Reviewing, checking and proofreading all booklets. 

Forming the Hindi pre-test booklets from translated reading items, translating writing tasks and original Hindi 
language structure multiple-choice questions. 


Checking again before ‘passing for print’ to ensure that the English and Hindi versions were ‘camera-ready’. 
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1.2.2 Mathematics 


The work was guided by the draft specifications for the Mathematics test prepared by NCERT, items from MAS 
and international examples from various sources [(including NAEP and Trends in International Mathematics and 


Science Studies (TIMSS)], and traditional and modern textbooks used in schools for Mathematics. 


Review of the textbooks immediately revealed that the approach to teaching/learning Mathematics advocated by 
the National Curriculum Framework (NCF) 2005 is significantly different from that of traditional syllabuses. There 
is a significant shift from formally setting out concepts and procedures to be learnt to an informal approach where 
topics related to Mathematics were discussed and explored through activities — rather than simply being presented 
from authority and then practised. This is obvious from the new textbooks which are significantly different in terms 


of content, complexity, language and even presentation. 


The child-friendly approach used here was in sharp contrast to the more formal approach used in traditional books. 
The lack of formal mathematical language which is a feature not only of the old textbooks but also the test items used 
in MAS for class V was also noted. 


The Working Group ran a simple analysis to check the extent to which the Mathematics test used for MAS is covered 
by the textbook for the new curriculum (‘Math-Magic’, NCERT 2008). This analysis showed that more than half of 
the 40 items used for MAS would not formally have been covered by students taught using this new textbook. There 
were some topics which, according to the NCF and the textbook, were not taught at class V. These include Highest 
Common Factor (HCF), Lowest Common Multiple (LCM), operations with decimals, types of triangles (acute, 
obtuse), meaning and calculation of average, percentages, and symbols </> (more/less). This would make the MAS 
test unfair for these students. Because of this, new tests for NAS, Cycle 3 were developed. 


Activities carried out in Mathematics Group 


m The Working Group came to a common understanding of the main principles of item writing and quality 
control. 


m The Working Group drafted more than 100 items. 

m All these items were peer reviewed. 

m The Working Group proposed the use of the following classification system for Mathematics topics: 
T1: Number System 
T2: Computations (operations) 
T3: Measurement 


T4: Geometry 


1.2.3 Environmental Studies 


The work was guided by the draft specifications for the EVS test prepared by the department, items from MAS 


and international examples from various sources (including NAEP), and traditional and modern textbooks used in 
schools for EVS. 


Prior to the seminar, DEME collected syllabuses and other information from the states. Not all states responded, but 
from those that did, a very complicated picture emerged. 


a 
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In EVS, as in Mathematics, the approach advocated by NCF 2005 is significantly different from that of traditional 
syllabuses. There is a significant shift from setting out a body of knowledge to be learnt to a less prescriptive approach 
where topics are discussed with students rather than simply being presented as correct. This is reflected in the new 


textbooks which are significantly different in terms of content, complexity, language and even presentation. 


The uptake of new syllabuses and materials has not been universal. Some states have adopted syllabuses and textbooks 
true to NCF whilst others have chosen not to make the transition. Even in states where new syllabuses have been 


developed, many schools continue to use old textbooks and, one suspects, traditional approaches. 


[his situation poses significant challenges for the development of EVS test booklets for the achievement survey. It 
was to decide whether the items be based on the old syllabus, the new syllabus, or something in between. What about 
the anchor items from MAS? Will these be equally appropriate in all states? Should anchor items that do not appear 
in NCF be deleted from TAS or not? 


Given this dilemma, the EVS subject group worked hard to generate items targeting fundamental concepts and 
principles of EVS. The focus was on what was important both for the students and for the achievement survey. 


The group developed a number of items designed to test ‘enabling skills’ such as reading information from a graph, 
bar chart or table. Items targeting the skill of inference from unfamiliar, given information were also developed. 
For achievers at the lower end of the ability spectrum, several items based on pictorial information were developed 
to lower the reading load. For example, some items provide four pictures showing a procedure and the child is 
asked to put them in the correct order. Some questions were based on the science of everyday situations, e.g., an 
item involving the evaporation of liquid from an open dish was designed to test children’s understanding of the 


underlying principle, i.e., ‘where has the water gone?'. 


All draft items were reviewed by the whole group to ensure that major concerns were heard and that a consensus 
could be reached on the suitability of each item. In this way, more than 140 items were drafted covering all the major 


themes of EVS. 


After the development of the items in EVS, the DEME faculty carried out the following activities: 
= Entered all items, prepared marking keys etc. into the computer. 

= Prepared artwork (maps, diagrams, charts, tables etc.) for items. 

m Selected the items for three booklets for pre-testing. 

m Reviewed, checked and did proof reading of the booklets. 

m Translated the English versions to Hindi and checked that the translations were valid. 


m Checked again before ‘passing for print’ to ensure that the English and Hindi versions were 'camera-ready'. 


1.2.4 Translation of items 


NCERT arranged a workshop for the translation of all items for pre-testing into 13 languages to be used in the 
survey. One person in each subject area was invited from each state to do this work. In a subsequent workshop, 
representatives of the states reviewed the translated items vis-a-vis English/Hindi items and made required corrections 
and modifications. Finally, in a training programme for administration of the assessment tools, state coordinators 


revisited all items selected for piloting and, where necessary, improved them. 
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The items were received using certain parameters like what subject matter is being tested; which cognitive behaviour 
is being exhibited in answering the question; is the key indisputably correct; is the task clean and the distractions 
plausible; is the language used of the level of the Class V students; and finally, are the items likely to be biased against 


any particular gender or ethnic group. 


1.2.5 Piloting of the test items 


In order to standardise the tests, they were piloted in 21 states to see how the items worked in different languages. 
The difficulty level (p-value) and discrimination index (DI) were computed using specialist software for each item. 
Item Characteristic Curves (ICC) were prepared and were carefully scrutinised to select suitable items for the final 


tests. By and large, the items having difficulty indices (p-values) between 0.2 and 0.8 were selected. 


1.2.6 Sampling for piloting 


The sampling procedure for the piloting of items was discussed. Given the time constraints and the need to gather 


meaningful data, the following procedures were used: 


1. A sampling strategy was developed based on District Information System for Education (DISE) data for the 
school year 2007-08. 


2. The sample would not be random, but based on expert judgement taking into account the statistical requirement 
of having enough records for each item for analysis and at the same time, diversity of the students/schools in the 
education system. 


3. Each item should be answered at least by 500 students for classical item analysis. As teach language version was 


considered a new item, so we needed 500 students per language version per item. 
4. Each item appeared in only one booklet. 


5. All students in a selected class participated in piloting where booklets in different subjects were more or less 
equally distributed among them. 


6. Schools in the state were selected taking into account the diversity of socio-economic background variables, i.e., 
some schools were selected from cities, some from small towns, some from rural areas, etc. (Since the expected 
number of students in rural schools is smaller than in urban schools, the overall number of selected rural schools 
was greater than urban schools.) 


7. All the three booklets in each subject were tested in all languages. However, in one state, only one medium was 
used. 


8. 225 students per district were selected (Hindi and English versions) with similar numbers achieved in other 
languages. 


1.2.7 Administration of tests for piloting 


m For piloting, DEME developed a handbook for district coordinators and test administrators. 
m Coordinators were trained in the required procedures. 
m Lists of selected schools were prepared for selected districts, 


m Field investigators were instructed as to how to administer tests in schools. 


m Field investigators visited each school on two successive days so that selected students could take tests in all three 
subjects. 
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m Student responses were transferred to data sheets by the field investigators after the completion of test 
administration. Data sheets were received by NCERT through state coordinators. 


1.2.8 Data analysis 


m Data entry was carried out by a private agency, but the quality of the data entry was controlled by NCERT. 


= Data was analysed by the psychometricians from Educational Testing Service (ETS). Their main task was to 
analyse data from the piloting exercise, including a trial application of IRT to the data for tests. 


m Data files from the piloting were analysed to give classical test and item statistics by using special analytical 
software. 


= Item parameters were used to select the items in the context of national assessment surveys. 


In addition to classical statistics, IRT parameters were estimated using specialist software including Bilog-MG and 


Parscale. Item response curves were generated and discussed in the group when considering the selection of items. 
= The performance of all items was reviewed in all regional languages, particularly in reference to English and 
Hindi. 


m Poorly performing and flawed items were rejected. 


1.2.9 Test booklet construction 


For the construction of booklets for the main survey, the following steps were taken: 


9" Reviewed all ‘new’ items by considering classical item statistics, parameters and ‘fit’ from the IRT analysis, and 
evidence of differential item functioning for different groups/languages. 
= Reviewed ‘old’ items, including those being considered for use as anchor items by considering statistical evidence 


of previous performance. Selected ‘good’ items. 


= Grouping of cognate items (i.e., by assessment objective) into time-limited ‘blocks’. 


It was decided that within a subject, all the three forms would contain a block of anchor items. In EVS and 
Mathematics, a minimum of 20 anchor items would be used. In Language, 15 items of reading comparison and 
5 items of language elements would be used as anchors. Therefore, three common passages would be used in each 
booklet. And each booklet would have a new passage also. The structure of the Mathematics and EVS booklet was 


as under. 


Form 1 Form 2 Form 3 


co i D 
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Table 1.2: Three dimensional grid for tests 


easy-3 easy-0 20 Items 
medium-4 medium-4 
hard-2 hard-3 


20 Items 


[— — — EHE: 
[  — Bem 
25 Items 


In all the subjects, the following domains were identified: 


EVs 
Social Studies 
eee 


In each domain, there were a number of sub-domains or topics. These items were again vetted by subject experts. 
Each test was reviewed in the light of the content area covered, competency covered, appropriate language, estimated 


difficulty level and also the homogeneity of distractors. A similar procedure was used for developing tests in different 


languages. While undertaking the translation activity, back translation was one of the ways adopted to authenticate 


whether the translated version retains the original meaning. 


Finally, for class V (NAS), each test form for EVS and Mathematics consisted of 40 multiple choice items. Thus, 
overall 80 unique items were used in each subject to measure learning achievement. In Language, in addition, each 
booklet included a writing task to test the writing skills of class V students. Scoring keys were also developed for each 
test form in each subject. 


In the cover page of the test, instructions for students and examples indicating how to record responses and change 
the response in case of any mistake on the test booklet were also prepared and translated in various languages for all 
the three subjects. 


1.2.10 Questionnaires 


Questionnaires for class V (NAS) were built upon experience from the earlier BAS and MAS surveys and incorporated 
ideas from international assessment instruments. For this survey, three questionnaires were developed to collect 
information on a) schools, b) teachers, and c) pupils and their backgrounds. The process of drafting questionnaires 


began in September 2009 and the pupil questionnaire was piloted in the field trial of the test booklets in November/ 
December 2009. 


W Draft questionnaires were prepared and sent to international experts for review. 


m Amended student questionnaires were tried out with test booklets, using a group of 100+ students chosen for 
convenience. Responses were then analysed and linkage with test booklets checked. 


m Amended teacher questionnaires were tried out by a group of invited teachers. 


The final version of the pupil questionnaire was translated into 15 Indian languages. The school and teacher 
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guestionnaires were produced in Hindi and English only, as it was considered that school principals and teachers 


were proficient at least in one of these languages. 


[he pupil questionnaire was strongly influenced by international best practices. Students selected for TAS were not 
sted in all three subjects. Therefore, the student questionnaire was revised so that it fits the new test administration 


rocedures—especially the distribution of the various test booklets among students (‘spiralling’). 


e pupil questionnaire contained questions pertaining to the home background of students. Areas touched upon 
uded parents’ level of education and occupation; help available at home for studies from parents and siblings; and 
study materials and resources available at home. The questionnaire also investigated the experience of pupils in 
ol. This included questions about class work and homework given by teachers, and whether they liked coming 


chool etc. 


school questionnaire sought information on the location, enrolment and structure of the school; the number of 
ool days; and the school’s infrastructure and environment. Other questions related to teachers’ job satisfaction and 


cir professional development opportunities, curriculum transaction strategies, and problems existing in schools. 


teacher questionnaire comprised questions regarding the age of teachers, academic and professional qualifications, 
ining programmes attended, teaching and evaluation practices, teaching materials available to them, interaction 


ch other teachers and the school head, and their job satisfaction. 


‘he teacher and school questionnaires should be analysed to check that the information which is available from 
ver sources is not being gathered (e.g. the school database used for drawing the sample). Avoiding duplication will 


¡prove efficiency. 


> The NAS Sample 


the class V (NAS) was designed to investigate learning achievement in the government system at the state/UT level. 
Hence, the target population for the survey was all class V children studying in government schools, local body 
schools, and government-aided schools. Completely private schools were not included in this survey. The proportion 


of pupils in private schools varies between states. 


In general, the sample design for each state/UT involved a three-stage cluster design which used a combination of 
two probability sampling methods. In the first stage, districts were selected using Probability Proportional to Size 
(PPS) sampling principles. This means that the probability of selecting a particular district depended on the number 
of class V students enrolled in that district. In the second stage, the requisite number of schools was selected in the 
chosen districts,. Once again, PPS principles were used so that large schools had a higher probability of selection 
than small schools. In the third stage, the required number of students in each school were selected using the Simple 
Random Sampling (SRS) method. In schools where class V had multiple sections, an extra stage of selection was 


added with one section being sampled at random. 


In the survey, PPS sampling was based on class V enrolment data from the DISE 2007-08. SRS sampling was 
conducted according to the class registers available in sampled schools. Although the DISE data was not free from 
criticism, it was used because it was considered to be the most complete and up-to-date enrolment data available 
at the time of sampling. Unfortunately, due to discrepancies in the DISE data, limitations in the sampling method 
and loss of information at the sampling and administration stages of the survey, it was impossible to estimate sample 


weights for the survey. Appendix I provides further details about the sampling design and procedures of the survey. 
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1.4 Participating States and Sample Coverage 


The survey was intended to cover all 35 states and UTs, but Arunachal Pradesh, Dadra and Nagar Haveli, and 
Lakshadweep could not participate in this endeavour. Manipur participated in the survey administration, but faced 
problems in data collection and failed to report its data on time. Among the 31 participating states and UTs, six 
states — Jharkhand, Meghalaya, Mizoram, Nagaland, Sikkim and West Bengal — could not test class V students at the 
end of their academic year, i.e., December 2009. Therefore, it was decided to test class VI children at the beginning 


of the next academic year. 


Exclusions of sub-populations from the total target population of NAS class V were made at the initial stage of 
sampling. Large scale educational surveys allow such exclusions for reasons such as ensuring administrative efficiency, 
as long as the excluded population does not critically affect the quality of the survey. For example, the exclusion 
of very small schools from a target population is often accepted. The class V (NAS) excluded schools having fewer 
than five students, or in some cases, nine students, depending on the enrolment characteristics of the state/UT. In 
addition to the small school exclusion, Upper Primary Only schools were excluded due to a classification error. As 
a result of these exclusions, population coverage of the class V sample varies from 7% to 99%. In five states/UTs of 
Assam, Daman & Diu, Goa, Kerala and Maharashtra, the population coverage fell below 80% mainly due to the 
Upper Primary Only school exclusion. It should be noted that it is virtually impossible in such surveys to achieve a 
sample which covers the entire population. However, if too many possible respondents are excluded, then the sample 
loses much of its value as a description of the population. NCERT set 80% coverage and above as acceptable for 
a representative picture for this study. Because of the arrangements for replacing non-cooperating schools with an 
equivalent (see Appendix II), it is considered that response rates at the school level are satisfactory. Unfortunately, no 


data is available for non-response within selected schools. 


The survey classifies the participating states/UTs into three different reporting groups according to their population 
coverage and the class tested. A group of 20 states is classified as having ‘coverage of 80 96 or more”. Another group 
of five states has ‘coverage less than 80%. Finally, a group of six states is classified as having ‘tested class VI students’. 
Table 1.3 summarises sampling coverage and reporting classification of the survey by state. 


Table 1.3: Sample coverage and reporting classification by state 


k Statesand | Population ossi id States and | Population 
UTs Coverage Classification UTs Coverage Classification 
e ea 

Coverage 
% Class V, Adequate Manipur Incomplete and late 
Coverage submission of Data (Not 
Reported) 
(EN eis BIN o 2. | Madhya Class V, Adequate 
u 937" | Maharashtra | 53% Class V, Inadequate 
Coverage 


"m Jm 
Coverage EE. 
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== — 585 0 
Haveli 
kg o ns 
Coverage Coverage 
A |  1 
Coverage ge 
LL lll 
Coverage Coverage 
(lass V, Adequate (lass VI 
eie 


i 


] 


Himachal Class V, Adequate Tripura Class V, Adequate 

Jammu & EE Class V, Adequate Uttar Pradesh | 9896 Class V, Adequate 

NEUEN 1 1 
Coverage 


Karnataka 90% Class V, Adequate West Bengal Class VI 
Coverage 


Table 1,4 shows that the states and UTS that participated in this survey vary greatly in their physical, demographic 
and socio-economic characteristics. For example, Bihar, Maharashtra and Uttar Pradesh each have populations of 
more than 100,000,000 whilst Daman & Diu, and the Andaman and Nicobar Islands have fewer than 400,000 
inhabitants. Mizoram has a population density of just 52 people per square kilometre whilst the corresponding figure 
for Delhi is over 11,000. The great disparity in the economic resources of states and hence the funding available for 


Kerala 59% Class V, Inadequate 
Coverage 


1.5 Characteristics of Participating States 


education is exemplified by the differences between economically advantaged states such as Delhi, Goa, Maharashtra 
and Haryana (each with GDP per capita greater than INR 50,000) to those with relatively low incomes such as Bihar 
and Madhya Pradesh (each with GDP per capita less than INR 20,000). 


Of particular importance in this survey are the significant differences in the provision of education at the class V 
level. For example, the target population for this survey was all class V students enrolled in government-run and 
government-aided schools. However, the proportion of class V students in such schools varied significantly amongst 
states, For example, in Bihar, West Bengal and Goa, nearly 100% of class V students are in government schools with 
an insignificant proportion in private schools. By way of contrast, in Nagaland, fewer than 50% of class V students 


are enrolled in government schools. 


These and associated factors are likely to influence student achievement and other educational outcomes. Therefore, 
when considering the findings of this survey and, in particular, when comparing the achievement levels of different 


states, it is important to take the prevailing conditions into account to ensure that like is being compared with like. 
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1.6 Administration of Tools 


When conducting NAS, NCERT takes the help of state agencies like SCERTs and SIEs to coordinate survey activities 
in the states/ UTs. Each participating state designates a state coordinator who has the responsibility of implementing 
the NAS in his/her state/UT in accordance with the NAS guidelines. The state coordinators are given training 
on how to collect data in the field. For this, a detailed guideline-cum-training manual was developed by DEME. 
Further, state coordinators provide training to district coordinators about the conduct of main achievement survey. 
In each selected district, district coordinators appoint 10 to 12 teams of field investigators. Each team comprises two 
field investigators. They are given rigorous training about selection of section and students in the sampled schools, 
administration of tools and transfer of response from test booklet to separate response sheet. These response sheets 
are collected by the district coordinators and then sent to the state coordinator after checking their number, coding 
of schools, and whether they have been properly filled by the investigators. These response sheets are dispatched by 
the state coordinator to NCERT where they are scored and analysed. Without the help, dedication, competence and 
experience of the state coordinators and their teams for which they should be commended, the massive task of data 


collection for the National Achievement Survey would not have been possible. 


1.7 Monitoring 


For monitoring, a financial provision at the state and district levels was made and funds were provided to states. It 
was communicated to the states that at least 10-15 schools are to be monitored randomly during the actual conduct 
of the survey by the SCERT faculty. Similarly, 5-10 schools in each district are to be monitored by the District 
Institute of Education and Training (DIET) faculty. The responses on questions regarding monitoring during the 
test administration and data collection did not reveal any clear system of monitoring. While 84% of the state officials 
and 95% of the district coordinators stated that they visited schools to monitor the administration of NAS but when 
asked how many times they visited the field, response from state coordinators revealed that 21% made visits to the 
field once and 21% said twice. The response of the district coordinators to the same question revealed that 23% 
made field visits twice and 16% said five times. 


NCERT team reflected that there was no monitoring done from their end while the survey was being conducted and 
they relied too heavily on the state and district coordinators to carry out the monitoring tasks. 


1.8 Data Management 


NCERT received material from all states regarding NAS field work. After getting material from the states, NCERT 
project team checked and organised materials school-wise and prepared batches having details about the school code, 
district code, number of response sheets, number of pupils and teachers, and school questionnaire and field notes. 
‘The codes of questionnaires and response sheets were matched and needful corrections were made wherever there 
was any discrepancy. 


Work was outsourced to a computer agency for transfer of data from paper forms to electronic format. Data entry 
plan and data analysis plan were developed in the department keeping in mind the objectives of the study. Both plans 


were provided to the computer agency for doing the assigned task in a systematic manner. 


‘The computer agency provided soft copy of the data entered. In the department, the project team checked and 
verified the quality of the data and resolved problems of mismatching files. Files of clean data were finalized for 
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further analysis. Data analysis was carried out by using both Classical Test Theory (CTT) and IRT. The analysis of 
data carried out is given in next section. 


1.9 Analysis of Data 


In earlier surveys (i.e. BAS and MAS), the learning achievement data was analysed using CTT and average scores 
were reported simply as the percentage of correct answers. This approach, whilst valid, has significant limitations. In 
particular, the results are linked to particular tests and groups of students so it is very difficult to use multiple tests or 
o link results from one year to another. Therefore, it was decided to analyse the data for this and future surveys using 
[tem Response Theory (IRT) in addition to the classical approach. This is in keeping with the best practice of major 

:ternational surveys such as Programme for International Student Assessment (PISA), Progress in International 


teading Literacy Study (PIRLS) and TIMSS. In this survey, a two-parameter logistic model was used (Appendix II). 


he main reason for administering the tests in this study was to obtain an estimate of the overall ability of the 
cudents tested. Previous studies have reported proportion correct scores on a range of items. This survey has seen the 
node of reporting scores changed to the more widely accepted IRT method. IRT assumes that there is a statistical 
onnection between the difficulty of an item, the ability of the student, and the probability of being successful on the 
tem. Students with higher ability scale scores are more likely to succeed on any item than their peers of lower ability, 
while all students are less likely to succeed on items with higher difficulty scores. In fact, a student's probability of 
success on a particular item is dependent on the difference between the ability of the student and the difficulty of 


he item. 


Whilst this method makes the analysis more complex than traditional methods, it has many advantages. Firstly, it 
places students and test items on the same numerical scale. This enables us to produce meaningful ‘maps’ of items 
and students. Secondly, in IRT, the difficulty parameter for an item does not depend on the group of test takers. 
This allows us to use multiple test booklets which can be ‘linked’ or equated. This can also be used, for example, 
to compare scores from tests used in different years/cycles — an essential characteristic for monitoring progress over 


time. 


In preparation for data analysis, data files and supporting documents were collated, checked and forwarded to ETS. 
The following files were provided: 

m Data entry manual and coding instructions 

m Copies of the final test booklets — 9 booklets (English language versions) 

m Spreadsheet showing structure and item positions for each booklet 

W Answer keys 

m Student responses (all test booklets) for Goa and Chandigarh 


m Corresponding responses for the school, pupil and teacher questionnaires 


ETS experts, after doing preliminary analyses, decided what kind of classical and IRT test analyses would be used 
for the analysis of the full dataset received from 31 states/UTs. Under CTT, the performance of students on anchor 
items was carried out by computing percentage correct scores and averages, standard deviations of test scores, and 
t-values between different groups. Under IRT, a detailed analysis was carried out to determine the scaled scores, 
standard errors, percentile scores, significant differences between the groups etc. The detail of the IRT model used 


is provided in Appendix II. 
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Besides, impact of the intervening variables was analysed by using statistical techniques of regression analysis. 


Regression analysis 


Regression analysis was used to see the impact of underlying variables in more detail. Regression analyses of outcome 
were conducted for a range of pupil and school factors, first for the factor on its own, and then after allowing for 


two ‘key’ factors: 
a) Socio-economic status 


b) Speaking language of instruction at home 


The variables analysed under pupil and school, and teacher related variables were of three types: dichotomous variables 
having only two possible discrete values; categorical variables having more than two possible discrete values; and, 
quasi-continuous variables having a wide range of possible values across a numerical scale (e.g., number of siblings). 


The treatment applied to each type of variable is described in chapter 8. 


1.10 Understanding the results 


1.10.1 The reporting scale 


Throughout this report, results are reported using ‘scale scores’ calculated using IRT. These replace the percentage 
correct scores that were used in previous reports. This change brings important advantages. Most importantly, the 
scale will be fixed so that results from future surveys can be reported on the same scale. Thus, provided adequate 
linking procedures through common items are incorporated, a score of, say, 270 today will be equivalent to a score 
of 270 in three years’ time, even though the items used are not the same. 


So if, for example, over a three-year period, a state’s average score in Mathematics rises from 248 to 254, we can 
compare these directly and draw meaningful conclusions about changes in student achievement. This is possible 
because even though the scores have been derived from different students taking different tests at different times, the 
reporting scale is fixed. 


‘The average score for the whole population tested is initially set at 250, with a standard deviation of 50. However, if 
educational standards improve, the overall average will rise. 


The Reporting Scale 


100 200 300 400 
| | | | 
e 
Low achievement Mid - point = 250 High achievement 


This means that the majority of students (about 70%) will have scores in the range 200 to 300. On this scale, a score 
of more than 400 would represent an extraordinarily high level of achievement. 


It should be noted that the adoption of this more sophisticated reporting scale means that it is not possible to make 
direct comparisons with the values reported in earlier surveys. 
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In this report, all values related to the achievement of students are given on scales calibrated to have 250 in the centre 
as described above. However, the scores for Mathematics, Reading Comprehension and EVS are derived by applying 


the same principles but independently. Therefore, it is important that readers do not compare scores across subjects. 


1.10.2 Tables of Results 


Tables of results presented in different chapters record basic statistics such as the average score achieved by students 
in a particular state in a particular subject. Average scores indicate how typical students performed in the survey's 
tests. However, in order to give information about the performance of lower-, middle- and higher-performing 
students, results are also reported at five key percentiles (10th, 25th, 50th, 75th and 90th). For example, the score at 
the 25th percentile is the score which 75% of students achieve or surpass, and the score at the 90th percentile is the 
score that 10% of students achieve or surpass. The range between the 25th and 75th percentiles (the inter-quartile 
range) represents the performance of the middle 50% of students. This, therefore, is a good indicator of the degree 


of homogeneity within a states student cohort. 


Where average scores are reported, these have been calculated for the students who were selected to take part in this 
survey. If other students had, by chance, been selected, then it is possible that a slightly different average would have 
been recorded. The likely size of this sampling error — an inevitable consequence of the student selection process — 


can be estimated and a measure of this is reported as the standard error associated with a value. 


‘The size of the standard error of a measurement should be taken into account when considering reported values. For 
example, the average EVS score for students in Gujarat was ‘250’ with an estimated standard error of about three 
scale points. This means that we can be 70% confident that the ‘true’ value of Gujarat's average EVS score lies in the 
range 247 to 253 (i.e. 250 + 3). Furthermore, we can be 95% confident that the ‘true’ value of Gujarat’s average EVS 
score lies in the range 244 to 256 (i.e. 250 + 6). 


The fact that all calculated values have an associated error is of particular importance when comparing, for example, 
the average scores of two states. For example, Gujarat has an average EVS score of ‘250’ which is lower that Orissa's 
average EVS score of ‘253’. But the standard error in both cases is approximately three scale points. This means that 
if we were to repeat the measurement using different samples of students, there is a significant chance that Gujarat’s 


score would now be higher than that of Orissa. 


To help readers make valid comparisons, many tables include the results of tests of significance. These are statistical 
checks which, by taking into account the two values being compared and their standard errors, indicate whether an 
observed difference is likely to be a true difference or whether it may have happened by chance. In this report, such 
tests have a confidence level of 95%. This means that if a difference is marked as being ‘statistically significant’, then 


the probability of it happening by chance is less than 5%. 


1.10.3 Tables related to pupil, teacher and school variables 


The nature of the pupil, teacher and school related variables is of different types — therefore, a different type of 
treatment was given for analysing data related to them. The information provided in the data tables is complicated 
in nature, therefore, some examples regarding reading tables and interpretation of data are given below. These show 
the regression results between different intervening variables and language achievement scores. Similar tables were 
created for Mathematics and EVS and all findings are given in chapters 8, 9 and 10. The three columns under 
the subject show the relation between the variables and subject score without and with allowing key background 
variables, namely the socio-economic background variables and speaking the language of instruction at home. 
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To understand the data provided in the table, an example for each type of variable is explained below. 


1. Dichotomous Variables 


In dichotomous variables such as “having a subject textbook’ there are only two possible discrete values: ‘have’ and 
‘don’t have’. One of these is taken as the base category and assigned a value of zero. Differences with respect to this 


base category are reported. The interpretation of dichotomous variables is given below: 


Table 1.5: Regression Results — Students having subject textbooks 


“Significant if P<.05 , **Significant if P«.01, NS-Not Significant 


In this case, ‘not having a textbook’ is taken as the base category. The coefficient of 8.46 (without including key 
variables) means that, on average, students with a Language textbook outscore those without by 8.46 scale score 
points. This difference is statistically significant. Taking the key variables into account reduces the coefficient slightly 
to 7.75, but the positive effect of having a textbook remains significant. 


2. Categorical Variables (with more than two values) 


.. 


The interpretatioh of categorical variables (with more than two values) is given in Table 1.6: 


Tribal Social Dept. 
Private aided 


Private aided 
"Significant if P<.05, **Significant if P<.01, NS-Not Significant 


Under this variable, there are five possible responses — government managed, zila parishad, local body, tribal schools 
and private aided. The largest category (government managed) is taken as the base category and its scores taken 
as the zero point, and regressions for the other categories expressed as deviations from this. The table shows that, 
for example, pupils from private aided schools perform significantly better than those from government managed 
schools in Language. On average, those in private aided schools outperform pupils in government managed schools 
by 16.96 score points. After including key variables, the difference is reduced slightly but still remains statistically 
significant. 
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3. Quasi-continuous Variables 


Finally for variables treated as quasi-continuous, the minimum number is taken as a base value. For example, the 

¡able “ i i ? € . p . 
variable number of siblings’ can have values 0, 1, 2,..., 10 or more and so is treated as quasi-continuous. In this 
case, zero is taken as the base value. 


The interpretation of continuous variables is given in Table 1.7: 


; Table 1.7: Regression Results - Siblings-wise | 


Variables 


t key variables 
/ variables 


tif P«,05, **Significant if P«.01, NS-Not Significant 


Here the coefficient -1.87 means that for each additional sibling, pupils on average score 1.87 points lower in 
Lar e. Therefore, pupils with two siblings will, on average, score 1.87 scale score points lower than their peers 
with < single brother or sister. Correspondingly, pupils with three siblings will, on average, score 3*(1.87) = 5.61 
points lower than those who have no brothers or sisters. This effect is lower when the key variables are taken into 
acc but remains statistically significant. an 

Y oae 


1.) Organisation of the Report 


The «port contains 11 chapters and appendices. 


Student achievement: In chapters 2, 4 and 6, achievement of class V students is presented. Their achievement in 


Lar ge, Mathematics and EVS are separately reported vis-a-vis the overall achievement of the other participating 
states in different groups. In addition, information about differences in achievement by students’ gender, school 
location and social category is also provided. 


What students know and can do: Chapters 3, 5 and 7 describe what class V students know and can do in Language 
(Reading Comprehension and Language elements), Mathematics and EVS respectively. For each subject, the test 
description is given along with the cognitive processes tested. To understand student performance in different 


subjects, item maps were prepared using the scale scores, mental processes and item description. 


Impact of student, school and teacher related variables on achievement of students: Chapters 8, 9 and 10 are 
each divided in two parts. Part 1 deals with profiles of student, school and teacher respectively. Whereas in Part II, an 


? MM : 
attempt is made to see the impact of student, school and teacher related variables on students attainment by using 


regression analysis. 
The last chapter of this report deals with equity and the success of the Sarva Shiksha Abhiyan programme in providing 
equality of opportunity. 


Besides the above stated chapters, the report contains a number of appendices providing more information about 


2 ; imati ing variance, performance on anchor 
sample design and procedures, scaling the NAS data and estimating sampling variance, p 
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items, creating a socio-economic index, list of surveyed states, districts, schools, teachers and students, list of state 


coordinators etc. 


1.12 Limitations 


This survey undoubtedly represents a significant step forward in the development of national achievement surveys in 


India. However, as with all such enterprises, lessons have been learnt. In conducting the Class V NAS, the following 


limitations have been noted so that they may be addressed in future achievement surveys: 
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The survey used DISE 2007-08 data from the National University of Educational Planning and Administration 
(NUEPA) as the primary sample frame. Once in the field, significant discrepancies between the DISE data and 


actual school enrolments were noticed. 


In some states, sampled schools were changed by the state personnel because of disturbances in states due to 


various reasons. Hence, the data collected in such states may not be as representative as initially planned. 


Due to discrepancies in the sample frame, deviation from agreed sampling procedures, and loss of information 


during administration, it was not possible to estimate sample weights for the survey. 


In the states of Jharkhand, Meghalaya, Mizoram, Nagaland, Sikkim and West Bengal, the tests had to be 


administered at the beginning of class VI rather than at the end of class V due to administrative reasons. 


In most of the states, responsibility for data collection was given to DIET faculty who, in turn, used their 
students as field investigators. On reflection, the training and hands-on practice given to these field investigators 
may not have been sufficient resulting in inefficiencies in the data collection procedure and, hence, increased 


demands during the data cleaning process. 


In order to meet the key objectives of this survey, schools and students were sampled in a systematic fashion. This 
meant that teachers could not be explicitly sampled in the same way. As a result, the analysis of teacher-related 
variables vis-à-vis student attainment could not be made in a comprehensive manner. 


In past surveys, the CTT model was used for developing tests and analysing the results. In this survey, IRT 


was used. These two methodologies are quite different. Therefore, the results of this survey are not directly 
comparable with those of past surveys. 


For the first time, NCERT used IRT for analysis of results instead of CTT. Therefore, results are reported in 
terms of scale scores rather than percentage correct scores, Whilst this is an important step towards emulating 
international best practice, unfamiliarity with this approach has undoubtedly made it more difficult for the 


lay reader to interpret results. It is hoped that as IRT becomes more widely used in India, understanding will 
improve. 


Chapter 2 


Student Achievement 
in Language 


CHAPTER 2 STUDENT ACHIEVEMENT IN LANGUAGE 


[he Language tests used in the NAS included three categories of items: those testing ‘reading comprehension’; those 
esting ‘language-specific elements’ such as vocabulary and grammar; and ‘extended writing’ tasks. The tests were 
:dministered in 15 languages. Within these, the reading comprehension passages and their associated items were 
translated directly and hence, are comparable. The language-specific items were of necessity, unique to each language. 
[he writing tasks were common across languages, but the variability of marking was too great to allow meaningful 
omparisons to be made. Therefore, this report focuses on student achievement in the reading comprehension domain 


nly. Information from the other language items will be subjected to secondary analysis and reported separately. 


'verall achievement in the reading domain is reported for each of the participating states and UTs. In addition, 
information about differences in achievement by student gender, school location and social category is provided. 
In the majority of states, students nearing the end of class V were tested. However, in a few states, the arrangement 
f the school year meant that students had to be tested at the beginning of class VI. Results for these groups are 


presented separately to reduce the chance of readers inadvertently comparing different cohorts. 


2.1 How did the states and UTs perform in Reading Comprehension? 


‘Tables 2.1, 2.2 and 2.3 show the distribution of student achievement for the 31 participating states and UTs. Each 
table represents one of the three categories: those where class V students were tested and where sample coverage was 
adequate; those where class V students were tested but where sample coverage was inadequate; and those where class 


VI students were tested. Within each group, states are listed in alphabetical order. 


The tables list each state's average score on a scale from 0 to 500. For each score, the ‘standard error’ is given to 
indicate the degree of imprecision arising from the sampling process. Finally, the tables indicate whether a state's 


average score is significantly different from the group’s average or not. 


Table 2.1: Average Reading Comprehension scores for states and UTs where class V students were tested and 
population coverage was >80% 


States and UTs 
aa misanas | 
[sar — — MAA — 
Chandigarh 
Chhattisgarh 
Delhi 


Gujarat 
Haryana 
Himachal Pradesh 
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Puducherry 


Uttar Pradesh 


Uttarakhand 
Group Average AA AAA 
€ The state's average score is not significantly different from that of the group. 


O The state's average score is significantly above that of the group. 
© The state's average score is significantly below that of the group. 


Twenty states and UTs represented in Table 2.1 are those in which class V students were tested and where the sample 
covered at least 80% of the target population. The average score for this group was 247 (with a standard error of 0.6). 
The results reveal substantial differences in Reading Comprehension achievement between the highest performing 
state (282 for Uttar Pradesh) and the lowest performing state (222 for Puducherry). Four states had average scores 
significantly above that of the group; seven states had average scores significantly below that of the group; and nine 


states had average scores that were not significantly different from that of the group. 


‘The group included nine states in which the language of assessment was Hindi. Amongst this group, there was a wide 
range of outcomes. Uttar Pradesh had the highest average level of achievement (282) and Bihar the lowest (228). The 
performance levels of the other states in the Hindi group fell between these extremes: Delhi (258); Rajasthan (251); 
Madhya Pradesh (250); Himachal Pradesh (241); Haryana (236); Uttarakhand (232); and Chhattisgarh (229). 


Table 2.2: Average Reading Comprehension scores for states and UT where class V students were tested and 
population coverage was <80% 


States and UT Significant Difference 


BERGL NM 
BEI UPS GENE 


Maharashtra 


Group Average 


€ The state's average score is not significantly different from that of the group. 
© The state's average score is significantly above that of the group. 
© The state's average score is significantly below that of the group. 


The five states and UTs represented in Table 2.2 are those in which class V students were tested but where the sample 
covered less than 8096 of the target population. For this group, great care should be taken when considering an 
average score as it may not be a reliable measure for the whole state/UT. 


Table 2.3: Average Reading Comprehension scores for states where class VI students were tested 


Standard Error Significant Difference 
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| Nagaland 


Sikkim 
West Bengal 
Group Average 


* The state's average score is not significantly different from that of the group. 
The state's average score is significantly above that of the group. 
he state's average score is significantly below that of the group. 


' six states represented in Table 2.3 are those in which class VI students were tested. For this group, the average 
was 251 (Standard Error 1.0). Mizoram and West Bengal performed significantly better than the group 
rage whereas the average scores of Sikkim and Jharkhand were significantly below the group average. 


tables and figures that follow illustrate the range of achievement within states and across groups of states. The 

sles list the scores achieved by students at key percentiles. For example, the score at the 25th percentile is the score 

ich 75% of students achieve or surpass; the score at the 90th percentile is the score that 10% of students achieve 
surpass. 

[he range between the 25th and 75th percentiles (the inter-quartile range) represents the performance of the middle 


0% of students. Hence, this is a good indicator of the states degree of homogeneity in terms of the Reading 


»mprehension achievement of its students. 


Table 2.4: Percentile scores in Reading Comprehension for states and UTs where class V students were tested and 
population coverage was >80% 
25 T5th goth | Range 75-25 
percentile | percentile percentile percentile 
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Figure 2.1: Percentile scores in Reading Comprehension for states and UTs where class V students were tested and 
population coverage was >80% 
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The inter-quartile range (i.e. the range between the 75th and 25th percentiles) is highly variable. For example, 
Puducherry has an inter-quartile range of just 39 whilst Uttar Pradesh has a corresponding value of 93. These values 
suggest that the class V population in Puducherry is far more homogeneous than that of Uttar Pradesh. In most 
states, the range of performance for the middle group was between 55 and 75 scale-score points. Performance at the 
10th and 90th percentiles respectively shows extremes in low and high achievement. The range between these two 
points, which includes 90 percent of the population, is highly variable ranging from 95 (Puducherry) to 157 (Uttar 
Pradesh). 


The percentiles provide additional information when comparing Reading Comprehension performance amongst 
states. For example, when the states are arranged in order of average score, the differences between adjacent states tend 
to be small. However, the range of scores may not be similar. For example, there is no significant difference between 
the median score of the Andaman and Nicobar Islands (227) and Uttarakhand (226). However, the score ranges 
between the 25th and 75th percentiles are very different: A & N Islands’ range is 51 compared with Uttarakhand's 
range of 70. This indicates that whilst average achievement is very similar in the two areas, Uttarakhand has a more 
heterogeneous group of class V students than the A & N Islands. 


Table 2.5: Percentile scores in Reading Comprehension for states and UT where class V students were tested and 
achieved population coverage was <80% 
States and UT 10th 25th 50th 75th 90th Range 75-25 | Range 90-10 
percentile percentile percentile percentile percentile 
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| Figure 2.2: Percentile scores in Reading Comprehension for states and UT where class V students were tested and 
| population coverage was <80% 
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The inter-guartile range for the states where class VI students were tested varied considerably from about 44 scale 
points in Sikkim to more than 80 points in Jharkhand. The range of scale points covering the population from the 
10th to the 90th percentile varied dramatically from the diverse states of Jharkhand (151) to Sikkim (80) where 
relatively little difference between high and low performing students was detected. It can be seen that even though 
West Bengal has a significantly higher median score than Nagaland (267 and 236 respectively), their scores at the 
90th percentile are comparable (331 and 330). This suggests that very high achieving students in Nagaland are at 


par with their peers in West Bengal. 


2.2 How did various groups perform in Reading Comprehension? 


The table below compares the average performances of different groups. Performance is compared by gender, school 
location, and social category. (The quoted scores were calculated for the 20 states and UTs where students were tested 
in class V and coverage of the population was at least 80% as this group gives the most reliable picture.) 


2.2.1 Are there any gender-related differences in Reading Comprehension? 


Table 2.7 compares the average Reading Comprehension scores achieved by boys and girls. It shows that within this 


group of states, no significant difference was detected in the average achievement levels of the two groups. 


Table 2.7: Average Reading Comprehension scores for groups by gender (class V) 


AAA - Bop Merage (5E) Girls' Average (SE) Significant Difference 
Group loy genden O up CI 


@ No significant difference between the average performance of girls and boys. 


Tables 2.8, 2.9 and 2.10 show that, in general, the general result, i.e., no significant difference between the average 
achievement of boys and girls, holds for all states and UTs. Only three exceptional cases were detected: the Andaman 
& Nicobar Islands, Kerala and Mizoram. In these, girls in the sample outperformed boys by a margin which is 


statistically significant. 
Table 2.8: Average Reading Comprehension scores, by gender, for states and UTs where class V students were tested 
and population coverage was >80% 
ABN sands ERO poem "ICI 
Andhra Pradesh A CA 
cat sole m — 
om  —— a 
A a a 
Himachal Prades E 


States and UTs Boys' Average (SE) Significant Difference 
Chandigarh 
Jammu & Kashmir 


mewmun aa | — i — | 
Em bar 
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| Puducherry 


Uttar Pradesh 
jttarakhand 

rou p Average 
e ignificant difference between the average performance of girls and boys. 
average performance is significantly greater than that of boys. 


¿ble 2.9: Average Reading Comprehension scores, by gender, for states and UT where class V students were tested 
and population coverage was <80% 


ses and Ur 
QUEM UM e — 
pu peces * | 
| ag iss | 

Rice OO 


© No significant difference between the average performance of girls and boys. 
è Girls’ average performance is significantly greater than that of boys. 


F Table 2.10: Average Reading Comprehension scores, by gender, for states where class VI students were tested 


Boys' Average (SE) Girls" Average (SE) Significant Difference 
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| Sikkim 


o] 


West Bengal 


Group Average 


e No significant difference between the average performance of girls and boys. 
O Girls' average performance is significantly greater than that of boys. 


2.2.2 Are there any differences in Reading Comprehension achievement related to school 


location? 


Table 2.11 compares the average Reading Comprehension scores achieved by students in rural and urban schools. 


It shows that, within this group of states, no significant difference was detected in the average achievement levels of 


the two groups. 


Table 2.11: Average Reading Comprehension scores for groups by location (class V) 


| E A Rural Average (SE) Urban Average (SE) Significant Difference 
Group (by school location) 248 (0.7) 249 (1.9) ¡A 
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@ No significant difference between the average performance of urban and rural schools. 


Tables 2.12, 2.13 and 2.14 show thar, in general, the general result, i.e., no significant difference between rural and 
urban students holds for all states and UTs. However, five exceptional cases were detected: in Andaman & Nicobar 
Islands, the rural students outperformed the urban students whereas in four other states, namely, Orissa, Assam, 


Mizoram and Sikkim, urban students in the sample outperformed rural students by a statistically significant margin. 


Table 2.12: Average Reading Comprehension scores, by location, for states and UTs where class V students were tested 
and population coverage was >80% 


States and UTs Urban Average (SE) 


Significant Difference 


A & N Islands SEED GU 
Andhra Pradesh 241 (3.5) 
238 (10.7) 
Chandigarh TEA 245 (3.1) 


hhattisgarh 
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Haryana 234 (2.1) 243 (3.8) 


Himachal Pradesh 
Jammu & Kashmir 
Karnataka 259 (6.3) 
Madhya Pradesh 244 (8.6) 

ao i) 
Puducherry 227 6.9) 

2963) 
Rajasthan 251 (5.7) 
Tamil Nadu ar (5.5) 
Uttar Pradesh 278 (15.2) 
Uttarakhand 227 (11.9) 


Group Average 248 (0.7) 


e No significant difference between the average performance of rural and urban students. 
© Rural students’ average performance is significantly higher than that of urban students. 
O Rural students' average performance is significantly lower than that of urban students. 


ved 


Table 2.13: Average Reading Comprehension scores, by location, for states and UT where class V students were tested 
and population coverage was <80% 


LINES 00 


Significant Difference 
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e No significant difference between the average performance of rural and urban students. 
© Rural students’ average performance is significantly lower than that of urban students. 
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Table 2.14: scores, by location, for states where dass VI students were tested 


ip Average 


nificant difference between the average performance of rural and urban students. 
tudents' average performance is significantly lower than that of urban students. 


3 Are there any differences in Reading Comprehension achievement related to caste 
category? 


: 2.15 compares the average Reading Comprehension scores achieved by students in different social categories. 
ows that within this group of states, no significant difference was detected in the average achievement levels of 
ents in the Scheduled Caste (SC) and Other Backward Class (OBC) categories. Students classified as being in 

)BC category significantly outperformed those in the Scheduled Tribe (ST) group. On average, students in the 
eral category achieved significantly higher scores than those in other categories. 


General 


* The average scores of the two categories being compared are not significantly different. 
© The average score of the category given in the first column is significantly higher than that of the category with which it is being compared. 
© The average score of the category given in the first column is significantly lower than that of the category with which it is being compared. 


2.3 Conclusion 


‘The average achievement of students in Reading Comprehension varies greatly across the states and UTs of India. 
There is a highly significant difference between outcomes in high scoring states such as Uttar Pradesh (282), Tamil 
Nadu (278) and Kerala (277), and low scoring states/UTs such as Puducherry (222), Bihar (228) and Chhattisgarh 


(229). 


States also vary greatly in the range between their lowest and highest achieving students as revealed by their inter- 
quartile score ranges. Some states/UTs such as Puducherry (39), Sikkim (44) and A & N Islands (51) have relatively 
homogeneous cohorts whilst others have far more diverse outcomes, e.g., Uttar Pradesh (93), Tamil Nadu (85) and 


Jharkhand (81). 


33 


National Achievement Survey 


Overall, no significant differences were detected in the average achievement of girls and boys. Similarly, no significant 
difference was detected between the achievement level of rural and urban students although exceptions were found 
in a small number of states/UTs. 


The survey did find that students from the General category outperformed their peers in the SC, ST and OBC 
categories by a statistically significant margin. 


The following chapter provides more information about what class V students at various levels of achievement know 
and can do in the domain of Reading Comprehension. 
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CHAPTER 3 LANGUAGE: 
WHAT STUDENTS KNOW AND CAN DO 


j.1 Overview of the Reading Comprehension Tests 


1e Reading Comprehension tests given to class V students consisted of three test booklets, each containing four 
ading passages with five multiple choice items on each passage. The passages were chosen to represent a range of text 
pes including informational passages, tables, public notices and stories. Three reading passages were common across 

test forms. These served as ‘anchors’ so that the different test booklets could be linked together and hence, all items 
uld be placed on a common scale. (See below.) In addition, each test form contained an extra, unique passage. Thus, 


Itogether the Reading Comprehension instruments used in the survey comprised six passages and 30 items. 


ie items were designed to test a range of relevant cognitive processes or ‘reading skills’. These are classified as ‘locate 
formation’, ‘grasp ideas and interpret’ and ‘infer and evaluate’ as defined below: 


Cognitive Processes for Reading Comprehension 


| Locate information: In items testing this process, students need to find and extract a specific piece of information explicitly stated 
in the text. "Locating' requires students to focus on a specific element of the given piece. 


Grasp ideas and interpret: In items testing this process, students need to demonstrate that they have understood an idea being 
conveyed in the text and have interpreted it correctly. For example, students may need to identify the text's main idea and/or the 

| sequence of events and/or relationships between ideas, events or characters across the text. In addition, students may need to draw 

| simple conclusions based on their interpretation of the text. 


| Infer and evaluate: In items testing this process, students need to demonstrate understanding beyond the information and/or 

| ideas stated explicitly in the text. They are asked to read between the lines and, for example, make inferences about the qualities or 
actions of characters. They may be asked to identify the text's underlying theme and/or evaluate its title by examining the text from 
more than one perspective. 


3.2 Item Mapping 


Following testing, the responses of students to the various tasks were analysed using IRT (see Appendix II). The three 
test forms were then aligned using the anchor items, thereby placing all items on a single Reading Comprehension 
scale comprising scores from 0 to 500. On this scale, the mean score was set at 250 with a standard deviation of 50. 
Calibrating the items according to their levels of difficulty places them on an ‘item map’ with the more demanding 
items at the top and the easiest items at the bottom. Such item maps give us a picture as to what students at different 


levels of ability know and can do. 


The item map for Reading Comprehension is given below. The scale score in the first column shows the level of 
difficulty for each item. This score also represents the score on the ability scale necessary for a student to have 50:50 
chance of success on the item. The map also includes a brief description of what students needed to do to answer 
the item correctly, i.e., each item is classified according to the cognitive process being evaluated. A student's scale score 
gives an indication of the possibility of success on an item, if the item difficulty is known. The higher the scale score, 
the more likely the student is to be able to answer; the higher the item difficulty, the less likely the student is to be 
able to answer correctly. Thus, the item with a difficulty of 313 was difficult for this population except for the high 
ability students, while the item with the difficulty of 203 is likely to be relatively easy on an average. 


The map shows that class V students demonstrate a wide range of ability in the domain of Reading Comprehension. 


37 


National Achievement Survey 


Students at the lower end of the scale, i.e., those with scale scores in the range of, say, 200 to 240 can demonstrate all 
three cognitive processes—provided that the context is clear and the tasks non-complex. For example, they are able 
to use information from a table to locate the time and the occurrence of a phenomenon, recognise a particular text 


type, and also make simple inferences about the causes of an act described in the text. 


Students performing in the intermediate range of the scale (say, 240 to 275) can do more. In addition to that 
described above, they can determine the causes, frequency, duration and sequence of events described in a variety 
of texts. They can also identify cause and effect relationships and make complex inferences about the qualities of 


characters from their actions, and identify the effect of a given activity on the characters within a text. 


Students performing at higher end of the scale, i.e., those with scale scores above, say, 275 can do more. In addition 
to that described above, they can identify the main theme of a given passage and evaluate the title. They can also 


Table 3.1: Item map in Reading Comprehension 


[ 38 | InfertEvaluate | Use information to identify the main theme and evaluate the title | 

| 305 | Graspideasiinterpret | Identify relationship between a pronoun and the object/person 

| 300 | |(noitem appeared at this difficulty level) 

| 293 | Grasp ideaslInterpret. | Use information in the text to identify the solution to a problem 

| 292 | GraspideaslInterpret. | Identify the causal relationship of two events 

| 285 | Grasp ideas/Interpret. | Identify relationship between an abstract idea and a concrete phenomenon 

Grasp the relevant idea about the thinking of people from the text 

Use information from a notice to conclude timing of an event 

EE EET ae Identify the correct place name from those given in the notice 

| 25 | | (no item appeared at this difficulty level) 

| 2% | locate | Use information from a table to determine the frequency of an event | 

| 265 | Grasp ideas/interpret_| Identify relationship between an object and its characteristics | 

| 264 | GraspideasInterpret | Determine the sequence of activities in a process | 

| 259 | Graspideaslinterpret | Use information in the story to identify the cause of an event 

| 258 | Grasp ideaslInterpret. | Use information in the story to grasp the problem 

| 255 | Grasp ideaslInterpret. | Use information in the story to determine the cause of an event 

| 252 | Grasp ideas/interpret | Use information from the notice to derive the duration of an event 

| 250 | locate [Use information from a table to determine the frequency of an event 

| 249 | Inferfyaluate — | Make complex inference about the quality of persons from their activities 
247 Use information in the text to make inference about the cause of an act 

| 27 | InferiEvaluate — | Make complex inference about the effect of an activity on concerned persons 

| 246 | Grasp ideas/Interpret_| Use information to draw simple conclusion about the usefulness of an object 

Use information in the text to identify the ingredients of an object 

Use information in a story to make a simple inference about the cause of an act 

SSE Ng apana a ts stad ER eT 

L locate | Use information in a table to identify the time for a phenomenon 


Note: Percent correct values from classical test theory are given in Appendix IV. 
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identify the relationship between a pronoun and the relevant object/person even when this is not immediately 
obvious. Furthermore, Table 3.1 of item map suggests that students at this level can identify the relationship between 
events, ideas and phenomena, and recognise the likely thoughts of characters in the text. 


1.3 Sample Item and Reading Passage 


[he passage and items reproduced below were used in one of the tests of Reading Comprehension. Statistics showing 


iow students responded to these items are given. These items can also be located on the item map. 


Direction: Read the following passage carefully and answer the questions given below it. Encircle the number 


»f the correct answer. 


Millions of people in the world are blind. Formerly, people thought that blind people could not do anything. But 
,owadays, many blind schools have been opened. All these facilities are available to the blind for studying. Now 
nany blind students are earning their livelihood after finishing their studies. Many blind people have become 
cholars in the world. Apart from this, the doctors are trying to prevent blindness among children by providing 


:ppropriate medical care and prescribing nutritious diet. 


Today, many people donate their eyes. After their death, their eyes are transplanted in the blind people's eyes. Thus, 


many blind persons are able to see. 


Sample item: Infer/Evaluate Scale score: 207 
item 46. Why do many people donate their eyes? 

1. Their eyes are weak. 
2 Blind people can become scholars. 
3: Their eyes will enable a blind person to see. 
4 They want to become famous. 


‘This item requires students to make inference about the cause of an action. The scaled score of this item was 247, i.e., 
very close to the average level of difficulty of items in the Reading Comprehension survey. Around 52% of students 
in the sample were able to select the correct answer (3). The figure shows how the remaining 48% responded. 


Figure 3.1 (Item 46): Percentage of students in each response category 


18 


1 2 3 4 Omitted 


This item requires students to integrate and use the information given in the text to arrive at the solution to a 
problem. The scale score of this item was 293, i.e., significantly above than the average level of difficulty of items in 
the survey. Only 39% of students in the sample were able to select the correct answer (2). The figure shows how the 


remaining 61% responded. 


This item requires students to grasp ideas and interpret the text to make an inference about the causal relationship of 
two events. The scale score of this item was 292, i.e., significantly above than the average level of difficulty of items 
in the survey. Only 40% of students in the sample were able to select the correct answer (4). The figure shows how 
the remaining 60% responded. 
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Omitted 


iple item: Locate information Scale score: 234 
49. What can a doctor do to prevent blindness? 
1. Provide medical care. 
D Train blind people. 
RE Provide nutritious diet. 
4. Turn the blind people into scholars. 


is item requires students to locate a specific piece of information given explicitly in the text. The scale score of this 
m was 234, i.e., below the average level of difficulty of items in the Reading Comprehension survey. As many as 
1% of students in the sample were able to select the correct answer (1). The figure shows how the remaining 46% 


sponded. 


E Figure 3.4 (Item 49): Percentage of students in each response category 
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Sample item: Grasp ideas/Interpret Scale score: 279 
Item 50. What did people think about the blind in the past? 
E There is no cure for blindness. 


2. Blind can get training. 
3. Blind cannot do anything. 
4, Blind can donate their eyes. 


The item requires students to interpret and grasp the relevant idea from the text. The scaled score of this item was 
279, i.e., significantly above the average level of difficulty of items in the survey. Only 40% of students in the sam ple 


were able to select the correct answer (3). The figure shows how the remaining 60% responded. 


Figure 3.5 (Item 50): Percentage of students in each response category 


Performance on the sample items reproduced here (i.e., items 46-50) varied across the country. Table 3.2 shows the 
proportion of students in each state or UT correctly responding to each item. The states/UTs are grouped according 
to the language in which the reading texts were presented as some variation in performance may be due to translation 
effects. 


Table 3.2: Performance on the sample items (46-50) in states and UTs 


Item 50 (%) 
VOTE 
Meo 
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Performance by states/UTs on the five items based on the reading passage about blindness. 

States/UTs marked * achieved samples representing «8096 of the target population. 

States/UTs marked ** tested students in class VI. 

Item 47 was deleted for Puducherry and Tamil Nadu because the characteristics for the translated item (Tamil) did not fit the IRT model. 
Assam tested students in Assamese and Bengali. Jammu & Kashmir tested students in English, Hindi and Urdu. 


1.4 What can students do in Reading Comprehension? 


35.4.1 Locating information 


In this chapter, it has already been mentioned what the students performing at different levels of scale scores of the 


Reading Comprehension items can do. 


Table 3.3 shows the performance of class V students on the cognitive process of locating information. 


Table 3.3: Performance of class V students on the cognitive process of locating information 


AN e 
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203 
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m About 71% students can use information in a table to identify an event occurring at a particular time. However, 


only 41% students can determine the frequency of events and identify the place name from the given information. 


3.4.2 Grasp ideas/Interpret 


Table 3.4 shows the performance of class V students on the cognitive process of grasp ideas/interpret. 


| Table 3.4: Performance of class V students on the cognitive process of grasp ideaslinterpret 


| Item No. | 


Grasp ideas/Interpret 


Recognise the text type as a notice 


Identify the ingredients of an object, identify the solution to a 
problem 


Draw simple conclusion about the usefulness of an object 


B 
HERE ERE 
Eu | HOS Jus. 
REN] ERG gm] 
BM C 5 
BETC RE 
NECEM Determine the cause of an event 
EM ^ .— —— PB 
|33 | Grasp the problem, the idea about people's thinking 
AR 219 

| | Determine the sequence of activities | 264 
a es 
PES 
E ES] 
e] 305 


Identify relationships 


m More than 60% students in the country can recognise the text type as a notice from the format and the conter 


m Only one-third of the students can identify relationship between a pronoun and the object or person. 


m About 50% students were able to draw simple conclusion about the usefulness of an object. 
3.4.3 Infer/Evaluate 
Table 3.5 shows the performance of class V students on the cognitive process of infer/evaluate. 


Table 3.5: Performance of class V students on the cognitive process of infer/evaluate 


Scale Value 


Inferlevaluate — 
Make a simple inference about the cause of an event/act, about 
the participation in a sport 


Make complex inference about the effect of an activity on 
concerned persons, about the quality of persons 


247 
ENTRA 249 
Dn m 
m Only one-third of the students are able to use information given in the text to identify the main theme and 
evaluate the title. 


Identify the main theme and evaluate the title 
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CHAPTER 4 ACHIEVEMENT OF STUDENTS 
IN MATHEMATICS 


This chapter summarises the achievement of class V students in Mathematics in the National Achievement Survey 
conducted in 2010. Overall achievement for each of the participating states and UTs is reported. In addition, 
information about differences in achievement by student gender, school location and social category is provided. In 
the majority of states, students nearing the end of class V were tested. However, in a few states, the arrangement of the 
school year meant that students had to be tested at the beginning of class VI. Results for these groups are presented 
separately to reduce the chance of readers inadvertently comparing different cohorts. 


For each state, a sample was drawn which was designed to be representative of the entire target population, i.e., all class 
V students studying in government and government-aided schools. In most states, the sample coverage achieved was 
regarded as satisfactory as it covered more than 80% of the target population. However, in some states, local logistical 
challenges and resource constraints meant that this criterion was not fully met and so the sample coverage, although 
significant, was deemed ‘inadequate’. To ensure that readers are aware of this when comparing achievement levels, 
results for states with adequate and inadequate sample coverage are reported separately.' 


4.1 How did the states and UTs perform in Mathematics? 


The distribution of student achievement in Mathematics for the 31 participating states is given in Tables 4.1, 4.2 and 
4.3. Each table represents one of the three categories described above: those where class V students were tested and 
sample coverage was adequate; those where class V students were tested and sample coverage was less than adequate; 
and those where class VI students were tested. Within each group, states are listed in alphabetical order. 


The tables list each state’s average score on a scale from 0 to 500. For each score, the ‘Standard Error’ is given to 
indicate the degree of imprecision arising from the sampling process. Finally, where such comparisons are appropriate, 
the tables indicate whether a state’s average score is significantly different from the group' average or not. 


A&N Islands X 
Andhra Pradesh = 
Chandigarh ; 
Chhattisgarh 


[uam — 1] 
Himachal Pradesh 
Jammu & Kashmir 


1 This follows the practice adopted in international surveys such as TIMSS and PISA where countries that do not meet sampling requirements are reported 
“below the line’. 
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€ The state's average score is not significantly different from that of the group. 
O The state's average score is significantly above that of the group. 
© The state's average score is significantly below that of the group. 


The 20 states and UTS represented in Table 4.1 are those in which class V students were tested and where the sample 
covered at least 80% of the target population. The average score for this group was 251 (with a standard error of 0.7). 


The results reveal substantial differences in Mathematics achievement between the highest performing states (298 
for Uttar Pradesh and 279 for Tamil Nadu) and the lowest performing states/UTs (217 for Puducherry and 226 for 
the Andaman and Nicobar Islands). In Mathematics, seven states had average scores significantly above that of the 
group; nine states had average scores significantly below that of the group; and four states had average scores that 


were not significantly different from that of the group. 


Table 4.2: Average Mathematics scores for states and UTs where class V students were tested 
and population coverage was <80% 


A ee 
ENT UI 


Exo | 


Significant Difference 


| —  — — BENED 


Maharashtra 


Group Average 


€ The state's average score is not significantly different from that of the group. 
© The state's average score is significantly above that of the group. 
© The state's average score is significa ntly below that of the group. 


The five states and UTs represented in Table 4.2 are those in which class V students were tested but where the sample 
covered less than 80% of the target population. For this group, great care should be taken when considering an 
average score or comparing it with that of other states as it may not be a reliable measure for the whole state/UT. 


Table 4.3: Average Mathematics scores for States where class VI students were tested 


BEER TIENES 2 0090 gm Significant Difference 


mandana Eu - 
iia "Mu . — 
DL MEM ——  Í Murs 
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Nagaland 
Sikkim 

Vest Bengal 
roup Average 


e The state's average score is not significantly different from that of the group. 
© The state's average score is significantly above that of the group. 
© The state's average score is significantly below that of the group. 


[he six states represented in Table 4.3 are those in which, due to local circumstances, class VI students had to 
be tested. For this group, the average Mathematics score was 246 (Standard Error 1.1). West Bengal performed 
significantly better than the group average whereas the average scores of Sikkim and Mizoram were significantly 
below the group average. 


4.1.1 How did scores vary within states and UTs? 


Tables 4.4, 4.5 and 4.6 and Figures 4.1, 4.2 and 4.3 illustrate the range of achievement within states and across 
groups of states. The tables list the scores achieved by students at key percentiles. For example, the score at the 25th 
percentile is the score which 75% of students achieve or surpass; the score at the 90th percentile is the score that 
10% of students achieve or surpass. 


The range between the 25th and 75th percentiles (the inter-quartile range) represents the performance of the middle 


50% of students. Hence, this is a good indicator of the state’s degree of homogeneity in terms of the achievement of 
its students in Mathematics. 


Percentile scores in Mathematics for states and UTs where class V students were tested and where 


adequate population coverage was achieved 
9L. 
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Figure 4.1: Percentile scores in Mathematics for states and UTs where class V students were tested and where 


adequate population coverage was achieved 
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Punjab 


Rajasthan 


Uttar Pradesh 


Uttarakhand 


Group Distribution 


The figure shows that the inter-quartile range is highly variable. For example, Chandigarh has an inter-quartile range 
of just 36 whilst Uttar Pradesh has a corresponding value of 85. These values suggest that in terms of Mathematics 
achievement, the class V population in Chandigarh is far more homogeneous than that of Uttar Pradesh. In most 
states, the range of performance for the middle group was between 50 and 80 scale-score points. Performance at the 
10th and 90th percentiles respectively shows extremes in low and high achievement. The range between these two 


points, which includes 90 percent of the population, is highly variable ranging from 86 (Puducherry) to 154 (Uttar 
Pradesh). 


The percentiles provide additional information when com 


paring Mathematics performance amongst states. For 
example, when the states are arranged in order of average s 


core, the differences between adjacent states tend to be 


small. However, the range of scores may not be similar. For example, there is no significant difference between the 


average score of Bihar (242) and Andhra Pradesh (238). However, the score ranges between the 25th and 75th 
percentiles are very different: Bihar's range is 71 compared with Andhra Pradesh’s range of 59. This indicates that 
whilst average performance in the two states is approximately the same, the class V cohort in Bihar is more diverse 
in its mathematical achievement. 
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Table 4.5: Percentile scores in Mathematics for states and UTs where class V students were tested and achieved 
population coverage was <80% 


percentile | percentile 


Daman & Diu 


Kerala 


Maharashtra 


Group Distribution 
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Jharkhand 
Meghalaya 
Nagaland 


West Bengal 
Group Distribution 
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Figure 4.3: Percentile scores in Mathematics states where class VI students were tested 
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The inter-quartile range for the states where class VI students were tested varied considerably from abo: scale 
points in Mizoram to 71 points in West Bengal. The range of scale points covering the population from t th to 
the 90th percentile (i.e., the range which includes 90 percent of the population) varied dramatically from hly 
diverse state of Jharkhand (143) to Sikkim (76) where relatively little difference between high and low ; 1ing 
students was detected. 
Interestingly, the data shows that whilst West Bengal has by far the highest median performance (270) in | oup, 
Nagaland and Jharkhand have scores at the 90th percentile which are comparable to that of West Ben: 24 cf. 
332). This suggests that high achieving students in Nagaland and Jharkhand are not lagging behind : ers in 


West Bengal. 


4.2 How did various groups perform in Mathematics? 


The tables below compare the average performances of different groups. Performance is compared by gender, by 
school location and by social category. (The quoted scores were calculated for the 20 states and UTs where students 


_ were tested in class V and satisfactory coverage of the population was achieved. This was to ensure that comparisons 
were made with the most reliable class V available). 


Table 4.7: Average Mathematics scores for groups by gender and by location (class V) 


Standard Error Significant Difference 
iem Banned 3 


e No significant difference between the average performance of girls and boys. 


Gender 
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Analysis of the results of 55,782 students within the states/UTs where adequate samples were achieved shows that 


there is no statistically significant difference in the average achievement levels of girls and boys in Mathematics. 


4.2,1 Are there any gender differences in Mathematics achievement at the state level? 


\s seen in Table 4.7, there is no significant difference in the average performance of girls and boys in Mathematics. 
Tables 4.8, 4.9 and 4.10 show that the general result holds for all states and UTs 


Table 4.8: Average Mathematics scores, by gender, for states and UTs where class V students were tested and 
population coverage >80% was achieved 


State or UT 
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© No significant difference between the average performance of girls and boys. 


There is no significant difference in the average performance of girls and boys in Mathematics in any of the states/ 


UTS where class V students were tested and where population coverage was adequate. 


Table 4.9: Average Mathematics scores, by gender, for states and UTs where class V students were tested and 
population coverage was <80% 


State or Union Territory Boys' Average (SE) Girls' Average (SE) Significant Difference 
pan | 

nananana — — BREED D 
= i RR RE RR 


Maharashtra 


€ No significant difference between the average performance of girls and boys. 
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The data in Table 4.9 shows that there is no significant difference in the average performance of girls and boys in 
Mathematics in any of the states/UTs where class V students were tested and where adequate population coverage 


(58096) was achieved. 


Table 4.10: Mathematics scores, by gender, for states and UTs where class VI students were tested | 


Group Average 


e No significant difference between the average performance of girls and boys. 
O Significant difference between the average performance of girls and boys favouring boys. 


Table 4.10 shows that in Jharkhand and Sikkim, (where Class VI students were tested), significant differences were 
detected in the average scores of girls and boys, with boys outperforming girls in both cases. 


4.2.2 Are there any differences in Mathematics achievement related to school location? 


Table 4.11 compares the average Mathematics scores achieved by students in rural and urban schools. It shows 
within this group of states, no significant difference was detected in the average achievement levels of the two gro: 


| Table 4.11: Average Mathematics scores for groups by location (class V) 
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* No significant difference was observed in the average achievement of urban and rural schools. 


Tables 4.12, 4.13 and 4.14 show average Mathematics scores by states/UTs and by location of school. 


Table 4.12: Average Mathematics scores, by location, for states and UTs where dass V students were tested and 
population coverage was >80% 


Urban Average (SE) 


Significant Difference 


Achievement of Students in Mathematics 


| Jammu 8 Kashmir 
| Karnataka 
Madhya Pradesh 


Orissa 
Puducherry 


Rajasthan 


Tamil Nadu 


Tripura 
Uttar Pradesh 
Uttarakhand 
Group Average 


* No significant difference between the average performance in rural and urban students. 
© Rural students" average performance is significantly greater than that of urban students. 
© Rural students" average performance is significantly lower than that of the urban students. 


Table 4.12 reveals that there was no significant difference in average Mathematics of students from rural and urban 
schools with two exceptions. In the case of the Andaman & Nicobar Islands, students from rural schools outperformed 
those from urban schools by a significant margin (mean scores of 234 and 215 respectively). Conversely, in Tripura, 
students in urban schools had a significantly higher average score than their peers in rural schools (mean scores of 


279 and 257 respectively). 


scores, by location, for states and UTs where class V students were tested and 


Ts bê] 
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. Table 4.13: Average Mathematics 


ETE) 


e No significant difference between the average performance of girls and boys. 
O Rural students' average performance is significantly lower than that of the urban students. 


Table 4.13 generally reinforces the data that suggests that there is no significant difference between Mathematics 
performance in rural and urban schools. Goa is a possible exception since, for this sample, urban students have 
outperformed rural students by a significant margin (256 cf. 233). However, given that population coverage here 


was less than 80%, this result should be treated with some caution. 


for states where class VI students were tested 


Table 4.14: Average Mathematics scores, by location, 
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© No significant difference between the average performance of girls and boys. 
© Rural students’ average performance is significantly greater than that of urban students. 
© Rural students’ average performance is significantly lower than that of the urban students, 


Table 4.14 tends to confirm the view that, overall, these is little or no significant difference in achievement of 
students in urban or rural schools. Sikkim (where urban students appear to do better than those in urban schoo! 
is one exception. However, the most notable exception is that of Nagaland where the absolute difference (22 scal 


scores) in favour of rural schools is very large. 


4.2.3 Are there any differences in Mathematics achievement related to social category? 


Table 4.15 below compares the average Mathematics scores achieved by students in different social categories 
shows that students in the General category achieved significantly higher average scores than those in other categoric 
Students classified as being in the OBC category significantly outperformed those in the ST category. No significan 
difference was detected in the average achievement levels of students in the SC and ST categories. 


Table 4.15: Average Mathematics scores for groups by social category (class V) ] 


General 


rent. 
icantly higher than that of the category with which it is being compared. 
ignificantly lower than that of the Category with which it is being compared. 


4.3 Conclusion 


The average Mathematics achievement of students varies greatly across the states and UTs of India. There is a great 
difference in outcomes in the group of high scoring states such as Uttar Pradesh (298), Tamil Nadu (279) and 
Karnataka (269) and the low scoring states/UTs such as Puducherry (217), Andaman & Nicobar Islands (226) and 
Chandigarh (229). 


States also vary greatly in the range between their lowest and highest achieving students as revealed by their inter- 
quartile score ranges. Some states/UTs, e.g., Chandigarh (36), Andaman & Nicobar Islands (37) and Puducherry 
(40) have relatively homogeneous cohorts whilst others—Uttar Pradesh (85), Tamil Nadu (84) and Karnataka 
(81)—have far more diverse outcomes. Therefore, when looking at Mathematics performance within a state/UT, it 
is important to consider not only the average score, but also the distribution of percentile scores. 
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Similarly, with a few exceptions, no significant difference was detected between the average achievement level in 
Mathematics of rural and urban students. In cases such as Tripura (favouring rural) and the Andaman & Nicobar 
Islands (favouring urban), further investigations may be necessary at the local level to explain these exceptional 


outcomes. 


Data from the survey confirms that overall, in Mathematics, students from the General category outperform their 
peers in the SC, ST and OBC categories by a statistically significant margin. 


The chapter which follows provides more information about what class V students at various levels of achievement 
know and can do in the domain of Mathematics. 
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Know and Can Do 


CHAPTER 5 MATHEMATICS: 
WHAT STUDENTS KNOW AND CAN DO 


5.1 Overview of the Mathematics tests 


The Mathematics achievement survey given to class V students consisted of three test booklets, each containing 40, 
four-option multiple choice items. Twenty items were common across all test forms. These served as ‘anchors’ so that 
the different test booklets could be linked together and hence, all items could be placed on a common scale. In total, 
the Mathematics assessment instrument comprised 80 unique items. 


The items in each text booklet were chosen to cover the following range of mathematical domains from the 
Mathematics curriculum: the number system, basic operations, measurement, geometry and patterns. In addition to 
the content domains listed above, items were constructed to test a range of cognitive processes or skills in a variety 
of contexts. These were classified as Knowing ‘Skill 1’, Applying ‘Skill 2’ and Reasoning “Skill 3’ as described below: 


Skills classification for test construction in Mathematics 


Knowing (Skill 1): In items testing this process, students are expected to answer using simple knowledge (recall) or recognition of 
terms and/or concepts familiar from their lessons. This skill also includes the application of basic operations in straightforward tasks, 


Applying (Skill 2): In items testing this process, students are expected to solve non-complex problems set in familiar situations by 
way of simple application of the operations/concepts learned in class V. 


Reasoning (Skill 3): In items testing this process, students are expected to use Mathematics concepts, principles, facts, etc. learned 
in the class in new or less familiar situations. In particular, students are expected to apply their Mathematical abilities to solving real 
world problems. 


5.2 Item Mapping 


Following testing, the responses of students to the various Mathematics tasks were analysed using Item Response 
Theory (see Appendix II). The three test forms were then aligned using the anchor items, thereby placing all items 
on a single Mathematics achievement scale comprising scores from 0 to 500. On this scale, the mean score was set 
at 250 with a standard deviation of 50. Calibrating the items according to their levels of difficulty places them on an 
‘item map’ with the more demanding items at the top and the easiest items at the bottom. Such item maps give us a 


picture as to what students at different levels of ability know and can do. 


The map for selected items from the Mathematics tests is given below. The scale score in the first column shows 
the level of difficulty for each item. Perhaps more importantly, this score also represents the minimum score on the 
ability scale necessary for a student to have an even (i.e., 50:50) chance of success on the item. The map (Table 5.1) 


also includes a brief description of what students needed to do to answer the item correctly. 
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Table 5.1: kem map for selected items from the class V NAS in Mathematics 


Question Description 


Scale Score Mental Processes 


Addition of two fractions 
Calculate the perimeter of squares * 


uy 


un 


2 
32 


Applying 
Reasoning 


| 


Calculate the difference between two decimal numbers* 

(no item appeared at this difficulty level) 

Identify smallest number divisible by two single digit numbers 
Identify the difference between fractions 


Reasoning 


w 
o 
e 


MN w 
c 


Reasoning 
290 Applying 
289 Reasoning Can subtract distance given in different units 
280 Reasoning Find the difference between numbers after changing position of digits* 
218 Reasoning 
Reasoning 


Reasoning 


Solve money problems involving fractions 
Solve an equation with one unknown 
Calculate an average of given values 


v1 


| Reasoming | 
| Reasoning | 
| Reasoming | 
267 Calculate the radius of a circle from given information * 
Calculate the perimeter of a square of given side 
Identify the largest number made from given three digits* 
Calculate the difference described in word problem* 
260 Able to convert minutes into hours 
258 Find the difference between two large numbers 
Identify the smallest angle in a given figure 
Select appropriate units for measuring length 
O AS Identify 45° as ‘half of a right angle’ 


248 Applying 
245 Applying 

Applying 
240 Applying 
237 


Calculate the period between two given times 

Find the difference between two digits in a number 
Calculate the number of hours in a week 

Multiply two digit numbers 

Find the angle between the hands of a clock 

Solve the word ‘problem’ 


| 


232 Applying 


228 Applying Multiply two given numbers 
25 ERR UE (no item appeared at this difficulty level) 
224 | Knowing | Convert volume of liquid into different units 


Find the place value of a digit in given number* 
Calculate time period from a given clock 

Identify the rectangle among given shapes* 
Understand the conversion of metres and centimeters 
(no item appeared at this difficulty level) 

Add two four-digit numbers* 

Identify the triangle among given shapes 


Items marked with an asterisk (*) are given as examples at the end of this chapter together with information as to how students performed. 
Note: Percent correct values from classical test theory are given in Appendix IV, 


214 Applying 
208 


205 Applying 


184 Applying 
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Items ranged in difficulty from the easiest with a scale score of 168 (recognising a triangle amongst other geometrical 
shapes) to the most difficult with a scale score of 422 (comparing three fractions in an authentic context). Using 
the item map and similar information for all the other test items, descriptions of what students know and can do at 
diferent levels of ability can be developed. Such descriptions based on evidence from the survey are given below. In 


idition, exemplar items are given to help subject teachers understand the statements. 


ants performing at the lower end of the ability scale, i.e., those with scale scores in the range of, say, 175 to 230, can: 
emonstrate basic mathematical knowledge, e.g., they know the place value of digits in the number system and can recognise 
eometrical shapes; and 
'pply fundamental concepts and perform basic operations in simple situations, e.g., they can use familiar units of time and 
near measure, and can perform one step calculations involving whole numbers. 
nis performing in the intermediate range of the scale, i.e., those with scale scores in the range of, say, 230 to 275, can do more. 
lition to that described above, they can: 
»erform a wider range of mathematical operations including multiplication and division; 
Jork with basic units and, where necessary, transform units such as g and kg, m and km, hours and minutes, etc.; and 
oply their knowledge to a range of problems set in authentic contexts (e.g., money calculations in the market) provided that 
he context is clear. 
nts performing at higher end of the scale, i.e., those with scale scores above, say, 275, can do still more. In addition to that 
ibed above, they can: 
:pply most or all of the mathematical operations required by the curriculum; 
'emonstrate understanding of fractions and fractional notation by comparing their sizes etc.; 
add decimal fractions and work confidently in a range of physical units including those of area; and 
solve more complex problems including authentic tasks such as those involving time and money calculations—even when 
these are set in less familiar contexts. 


Sample Items 


sample items given below are intended to exemplify student achievement in selected mathematical domains at 
« distinct levels within the ability range. For each item, the proportion of students choosing the correct answer 
varked *) and each of the incorrect options is given. A table at the end of this section shows the proportion of 


students selecting the correct answer within each participating state/U T. 


5.5.1 Number system 


Sample item: Find Place Value Scale score: 223 (easy) 


Item 71. The place value of 4 in 294301 is... 


14 2. 40 
3. 400 4. 4000 


This item requires student to find out place value of a digit in a given number. The scale value of the item is 223, 
significantly below average difficulty of all items used in the survey. A total of 61% students have identified the 


correct answer as (4). The figure shows distribution of remaining 39% responses. 
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Figure 5.1 (Item 71): Percentage of students in each response category 


61 
ð 14 
4 7 
1 2 3 4 


Omitted 


Sample item: Find largest number Scale score: 262 (intermediate) 


Item 3. Renu has the following three number cards: 


LA] ES 


Which is the largest 3-digit number she can make using all cards? 
1. 
3: 


518 2. 857 


875 4. 999 


This item requires student to form the largest three digit number using all three numbers written in cards. The scale 
value of the item is 262, i.e., close to the average difficulty of all items in the survey. In this item, 45% of students 
chose the correct answer as (3). Note that 37% chose incorrect option (4) which is the largest three digit number but 
is not made using the given numbers. The figure shows the remaining 18% responses. 


Figure 5.2 (Item 3): Percentage of students in each response category 
50 


Omitted 


Sample item: Number difference Scale score: 280 (hard) 
Item 49. The digits 3 and 4 of the number 354 are inter-changed to form a new number. What is the difference between the new 
number and the original number? 
1. 99 2. 101 
3. 109 4. 199 


Mathematics: What Students Know and Can Do 
This item requires students to not only transform a given number, but also calculate simple difference of numbers. 


The scale value of the item is 280, significantly above average difficulty of all items used in the survey. A total of 40% 
students have identified the correct answer as (1). The figure shows distribution of remaining 60% responses. 


E Figure 5.3 (Item 49): Percentage of students in each response category | 


Scale score: 184 (easy) 


11 sem requires students to calculate simple addition with carrying of two four-digit numbers. The scale value of 
d m is 184, significantly below average difficulty of all items used in the survey. A total of 76% students have 
identified the correct answer as (2). The figure depicts distribution of remaining 24% responses. 


M Figure 5.4 (Item 44): Percentage of students in each response category 


Omitted 
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Sample item: Calculate the difference Scale score: 261 (intermediate) 


Item 45. How much greater is 555 than 198? 


1. 357 2. 358 
3. 367 4. 753 


This item requires students to calculate the difference satisfying the given condition. The scale value of the item is 
261 which is close to the average difficulty of all items used in the survey. In this item, 45% of students chose the 
correct answer (1). Note that 26% chose incorrect option (4) which is the sum of 555 and 198 rather than the 
difference. The figure shows how the remaining 29% responded. 


Figure 5.5 (Item 45): Percentage of students in each response category 


Sample item: Calculate the difference in decimal numbers Scale score: 304 (hard) 
Item 28. What is the difference between 500.2 and 499.101? 

1. 1.099 2. 1.101 

3. 1.109 4. 1.99 


This item requires student to calculate difference between two decimal numbers. The scale value of the item is 304, 


significantly above average difficulty of all items used in the survey. A total of 34% students have identified the 
correct answer as (1). The figure depicts distribution of remaining 66% responses. 


Figure 5.6 (Item 28): Percentage of students in each response category 


66 


Mathematics: What Students Know and Can Do 


5.3.3 Geometry 


| Sample item: Identify desired shape Scale score: 208 (easy) 
7,442. Which of the following figures is a rectangle? 


:m requires students to identify the rectangle from amongst given shapes. The scale value of the item is 208, 
intly below average difficulty of all items used in the survey. A total of 68% students have identified the 
answer as (2). The figure depicts distribution of remaining 3296 responses. 


7 Figure 5.7 (Item 42): Percentage of students in each response category 


Omitted 


| Sample item: Find the radius Scale score: 267 (intermediate) 
Item 38. In the figure given here, the radius of the smaller circle is 3 cm. What is the radius of the larger circle having centre 0? 
1. 3cm 
2. 6cm ¿GN 
3. 9cm 
4. Tem CHE, 


This item requires student to find the radius of a circle from information given in the diagram. The scale score of the 


item is 267, i.e., close to average level of difficulty of item in the survey. About 43% of students chose the correct 
answer (2). Note that 2496 chose incorrect option (1) which suggests that they read the diameter of the smaller circle 


to be 3 cm. The figure shows how the remaining 33% responded. 
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Omitted 


Item 80. In the figure given here, there are four equal squares, each of perimeter 24 cm, joined together. What is the perimeter of 
the shaded part of the figure? 


This item requires students to calculate perimeter of a rectangle formed by a number of squares of known perimeter. 
The scale score of the item is 321, i.e., above average level of difficulty of item used in the survey. About 36% chose 
the correct option (3) and 24% chose incorrect option (4) in this item. This suggests that they included the two 


internal edges that do not constitute part of the perimeter. The figure shows the response pattern of remaining 40% 
students. 


Figure 5.9 (Item 80): Percentage of students in each response category 


36 
24 
14 15 
11 
1 2 3" 4 


Omitted 


Table 5.2 shows the proportion of students responding correctly to the sample items given above. 
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Table 5.2: The proportion of students selecting the correct option in each of the 


nine sample items given above by state/UT 

[ — State UT Geometry 
| item71 | ttem3 | ttemúo | Item | item 45 | item28 | Item 42 | Item 38 | Item 80 
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Warden EE å å ëE o a 
in EE — 0M o RS 
Wehen — in i » D NM o Bw 
All sample Du rn c PA e [ss 


1. States/UTs marked * achieved samples representing <80% of the target population. 
2. States/UTs marked ** tested students in Class VI. 
3. Due to translation effects, items 31 and 40 were deleted in Goa. 


5.4 What can students do in Mathematics? 


5.4.1 Computations (Operations) 


In this chapter it has already been mentioned what the students performing at different levels of content domain on 


Mathematics items can do. Table 5.3 shows the performance of students of class V on various cognitive processes or 


skills on Basic Operations. 


a 
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Table 5.3: Performance of class V students on Computations (Operations) 


Applying (Skill 2) Reasoning (Skill 3) 
| Scale Value | % Correct | ItemNo. | Scale Value 
A 


| 
i 


n2 
= 


304 


224 


x 


67 


8 
uy 


247 


Knowing (Skill 1) 


m About two-thirds of the students can identify the smallest four digit number (Item 51) and can also write the 
four-digit numeral in words (Item 31). 


Applying (Skill 2) 


m About half of the students can use the knowledge of basic operations in solving the items such as to find out the 
place value of a number in a six-digit number (Item 19). 


m Nearly one-third students can solve the question based on fractions such as identification of equivalent fractions 
(Item 53) and differentiate between equivalent and non-equivalent fractions (Item 63). 
Reasoning (Skill 3) 


m Only one-third of the students can compute the difference between two decimal numbers (Item 28). 
5.4.2 Geometry 


Table 5.4 shows the performance of class V students in Geometry in terms of percent. 


Table 5.4: Performance of class V students in Geometry 


Knowing (Skill 1) Applying (Skill 2) Reasoning (Skill 3) 
| Scale Value | % Correct | | tem No. | Scale Value | % Correct | | Item No. [ Scale Value | % Correct | 
-a  — o a 


| Item no. | 

E 
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Knowing (Skill 1) 


Mun 


p———- 


Above 80% students can identify the figure of a triangle (Item 14). 


About three-fourths of the students cannot identify the largest angle among the given angles in a geometrical 
ure (Item 62). 


ing (Skill 2) 


ut 79% students can count the sides of a given figure (Item 8). 
it 70% students cannot identify the number of triangles embedded in a large triangular figure (Item 68). 


than 6596 students cannot compute area from the given side in a square (Item 78). 


/[easurement 


; shows the performance of class V students in Measurement in terms of percent. 


E Table 5.5: Performance of class V students in Measurement | 
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Knowing (Skill 1) 


W About 59% students can do simple measurement problems (Item 13). 


Applying (Skill 2) 


Nearly half of the students can apply the knowledge of measurement in solving problems like computation of 
area of a rectangle of given dimensions (Item 7): 
About two-thirds of the students can read the time given ina clock (Item 37). 


About 60% students cannot match equivalence of measurement scales/units (Item 24). 


a 
m More than half of the students cannot compute the perimeter of a given square (Item 67). 
Reasoning (Skill 3) 


m Only 22% students can do word problem based on money spent on different heads (Item 50). 
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5.4.4 Number System 


Table 5.6 shows the performance of class V students on the Number System in terms of percent. 


Table 5.6: Performance of class V students on the Number System 


doping (S3 
item No. 


Knowing (Skill 1) 
m About 54% students can do simple problems of number system (Item 12). 


Applying (Skill 2) 


W More than two-thirds of the students can add two four-digit numbers (Item 44) and can also add two 


-digit 
numbers with carry (Item 21). 


m About three-fourths of the students cannot compute sum of the fractional number with different denominator 
(Item 75). 


Reasoning (Skill 3) 


m About 60% students can find multiplier of a given number (Item 29). 
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CHAPTER 6 STUDENT ACHIEVEMENT IN 
ENVIRONMENTAL STUDIES 


This chapter summarises the achievement of students in EVS in the NAS. Overall achievement for each of the 


ticipating states and UTs is reported. In addition, information about differences in achievement by student 
er, school location and social category is provided. In the majority of states, students nearing the end of class 
ve tested. However, in a minority of states, the arrangement of the school year meant that students had to be 
| at the beginning of class VI. Results for these groups are presented separately to reduce the chance of readers 


ertently comparing different cohorts. 


ach state, a sample was drawn which was designed to be representative of the entire target population. In 
states, the sample coverage achieved was regarded as satisfactory as it covered more than 80% of the target 
oulation. However, in some states, local logistical challenges and resource constraints meant that this criterion was 
met and so the sample coverage, although significant, was deemed inadequate. To ensure that readers are aware 


is when comparing achievement levels, results for states with inadequate sample coverage are reported separately. 


How did the states and UTs perform in Environmental Studies? 


bles 6.1, 6.2 and 6.3 show the distribution of student achievement for the 31 participating states and UTs. Each 
e represents one of the three categories: those where class V students were tested and where sample coverage was 
quate; those where class V students were tested but where sample coverage was inadequate; and those where class 


| students were tested. Within each group, states are listed in alphabetical order. 


e tables list each state’s average score on a scale from 0 to 500. For each score, the ‘standard error’ is given to 


dicate the degree of imprecision arising from the sampling process. Finally, the tables indicate whether a state’s 


werage score is significantly different from the groups average or not. 


Table 6.1: Average EVS scores for states and UTs where class V students were tested 
and the population coverage was >80% 
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Uttarakhand 
Group Average 


€ The state's average score is not significantly different from that of the group. 
€) The state's average score is significantly above that of the group. 
© The state's average score is significantly below that of the group. 


The 20 states and UTs represented in Table 6.1 are those in which class V students were tested and where the sample 
covered at least 80% of the target population. The average score for this group was 249 (with a standard error of 0.7). 
The results reveal substantial differences in EVS achievement between the highest performing state (288 for Tamil 
Nadu) and the lowest performing state (222 for Puducherry). In EVS, seven states had average scores significantly 


above that of the group; nine states had average scores significantly below that of the group; and four states had 
average scores that were not significantly different from that of the group. 


Table 6.2: Average EVS scores for states and UT where class V students were tested 


and the population coverage was <80% 


Group Average 


e The state's average score is not significantly different from that of the group. 
O The state's average score is significantly above that of the group. 
© The state's average score is significantly below that of the group. 


The five states and UT represented in Table 6.2 are those in which class V students were tested but where the sample 


covered less than 80% of the target population. For this group, great care should be taken when considering an 
average score as it may not be a reliable measure for the whole state/UT. 


Table 6.3: Average EVS scores for states where class VI students were tested 


Group Average 


9 The state's average score is not significantly different from that of the group. 
€) The state's average score is significantly above that of the group. 
O The state's average score is significantly below that of the group. 


76 


Student Achievement in Environmental Studies 


The six states represented in Table 6.3 are those in which class VI students were tested. For this group, the average 
EVS score was 254 (standard error 1.1). West Bengal performed significantly better than the group average whereas 


the average scores of Sikkim and Jharkhand were significantly below the group average. 


tables and figures that follow illustrate the range of achievement within states and across groups of states. The 
sles list the scores achieved by students at key percentiles. For example, the score at the 25th percentile is the score 
hich 75% of students achieve or surpass; the score at the 90th percentile is the score that 10% of students achieve 


irpass. 


range between the 25th and 75th percentiles (the inter-quartile range) represents the performance of the middle 
| of students. Hence, this is a good indicator of the state's degree of homogeneity in terms of the EVS achievement 


students. 


| Table 6.4: Percentile scores in EVS for states and UTs where class V students were 
| tested and the population coverage was >80% 


States and UTs 


8 N Islands 
| Andhra Pradesh 
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140 
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Note: Ranges may not agree due to rounding. 
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Figure 6.1: Percentile scores in EVS for states and UTs where class V students were tested | 
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The inter-quartile range (i.e., the range between the 75th and 25th percentiles) is highly variable. For example, 
Chandigarh has an inter-quartile range of just 38 whilst Uttar Pradesh has a corresponding value of 89. These values 
suggest that the class V population in Chandigarh is far more homogeneous than that of Uttar Pradesh. In most 
states, the range of performance for the middle group was between 50 and 80 scale score points. Performance at 
the 10th and 90th percentiles respectively shows extremes in low and high achievement. The range between these 
two points, which includes 90 percent of the population, is highly variable ranging from 89 (Chandigarh) to 149 
(Chhattisgarh and Madhya Pradesh). 


The percentiles provide additional information when comparing EVS performance amongst states. For example, 
when the states are arranged in order of average score, the differences between adjacent states tend to be small. 
However, the range of scores may not be similar. For example, there is no significant difference between the average 
score of Bihar (236) and Andhra Pradesh (238). However, the score ranges between the 25th and 75th percentiles 
are very different: Bihar's range is 80 compared with Andhra Pradesh's range of 54. This indicates that whilst average 
achievement is very similar in the two areas, Bihar has a more heterogeneous group of class V students than Andhra 


Pradesh. 
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Table 6.5: Percentile scores in EVS for states and UT where class V students were tested 


and the population coverage was <80% 
10th 25th 50th 75th 90th Range 75-25 | Range 90-10 
percentile percentile percentile percentile percentile 
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Figure 6.2: Percentile scores in EVS for states where class V students were tested 
and the population coverage was <80% 


c T — " T T gem 
150 175 200 225 250 275 300 325 350 


States and UT 10th 25th 50th T5th Range 75-25 | Range 90-10 
percentile | percentile | percentile percentile | percentile 


ee 
[Mizoram [w | 
[Nagaland es | 
E 
E 


Group Distribution 


79 


National Achievement Survey 


Figure 6.3: Percentile scores in EVS for states where class VI students were tested 
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The inter-quartile range for the states where class VI students were tested varied considerably from about 44 scale 
points in Sikkim and Mizoram to more than 75 points in Nagaland and Jharkhand. The range of scale points 
covering the population from the 10th to the 90th percentile varied dramatically from the diverse state of Jharkhand 
(150) to Mizoram (69) where relatively little difference between high and low performing student was detected. 


Performance between 10th and 90th percentile, which includes 90 percent of the population, was between 69 
for Mizoram and 150 points for Jharkhand. It can be seen that even though West Bengal has the highest median 
performance (270), Nagaland has a higher score at the 90th percentile, suggesting that its high achieving students 


do extremely well. 


6.2 How did various groups perform in Environmental Studies? 
The tables below compare the average performances of different groups. Performance is compared by gender, by 


school location, and by social category. (The quoted scores were calculated for the 20 states and UTs where students 
were tested in class V and coverage of the population was at least 8096 since this group gives the most reliable picture.) 


6.2.1 Are there any gender-related differences in EVS achievement? 


Table 6.7 compares the average EVS scores achieved by boys and girls. It shows that, within this group of states, no 
significant difference was detected in the average achievement levels of the two groups. 


Table 6.7: 


| 0) — 88 8 


© No significant difference between the average performance of girls and boys. 
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Tables 6.8, 6.9 and 6.10 below show that, in general, the general result, i.e., no significant difference between the 
average achievement of boys and girls holds for all states and UTs. 


Table 6.8: Average EVS scores, by gender, for states and UTs where class V students were tested and population 
coverage was >80% 


N Islands 230 (2.6) 
ira Pradesh 240 (2.3) 
oi 
idigarh 227 (2.3) 
tisgarh 234 (3.7) 
EE 
: 63 
chal Pradesh 242 (2.9) 
nu & Kashmir 259 (2.9) 258 (3.4) 
ataka 274 (2.9) 
ihya Pradesh 263 (3.6) 
: oa 
icherry 218 (2.0) 
jab 246 6.1) 
jasthan 246 (3.0) 


| j States and UTs Boys' Average (SE) Girls' Average (SE) Significant Difference 
| 


ail Nadu 288 (2.7) 
jura 253 (3.9) 
ar Pradesh 283 (3.8) 
Uttarakhand 238 (3.0) 


Group Average 249 (0.7) 250 (0.8) 


© No significant difference between the average performance of girls and boys. 


Table 6.9: Average EVS scores, by gender, for states and UT where class V students were tested and population 
coverage was <80% 


Boys’ Average (SE) Girls" Average (SE) Significant Difference 


P| AN CA 
= eo "xw oe A 


252 (1.7) 
€ No significant difference between the average performance of girls and boys. 
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Table 6.10: Average EVS scores, by gender, for states where class V students were tested 


manane [— wk 08 
Meghalaya 257 (3.0) 


to Sa 
255 (4.0) 


[ — mast 
NEC eae 
epo O aa 
Dum TET | 9 | 
esee | — 3989 — | — 3863 — 
[ouwe | — 383 — | — 363 — 


@ No significant difference between the average performance of girls and boys. 


6.2.2 Are there any differences in EVS achievement related to school location? 


Table 6.11 compares the average EVS scores achieved by students in rural and urban schools. It shows that within 


this group of states, no significant difference was detected in the average achievement levels of the two groups. 


Table 6.11: Average EVS scores for groups by location (class V) 


| a Rural Average (SE) Urban Average (SE) Significant Difference 
Gents] | 5008) | won | a 


€ No significant difference was observed in the average achievement of urban and rural schools. 


| 


Tables 6.12, 6.13 and 6.14 below show that, in general, the general result, i.e., no significant difference between rural 
and urban students holds for all states and UTs. However, four exceptional cases were detected: in A & N Islands, 
Daman and Diu and Nagaland, the rural students outperformed the urban students whereas in Goa, 


the urban 
students outperformed the rural students by a margin which is statistically significant. 


Table 6.12: Average EVS scores, by location, for states and UTs where class V students were tested and population 


coverage was >80% 
States and UTs 


Rural) 
aansens A 
| anana paten — REL A 
CO — — AA 
ren — — pc RA 
C [o O — 
enews | 
TONER | 
Lor | 


Rural Average (SE) Urban Average (SE) Significant Difference (Urban/ 
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Orissa 
Puducherry 

| Punjab 
jasthan 

Tamil Nadu 


r Pradesh 
arakhand 
roup Average 


¿ significant difference between the average performance in rural and urban students. 
ral students' average performance is significantly greater than that of urban students. 


Table 6.13: Average EVS scores, by location, for states and UT where class V students were tested and population 
$ coverage was <80% 
Rural) 


Pa CI 


States and UT 


jaman & Diu ie ea A 
T 228 (3.0) 244 (6.3) 


ENS MES DRE 
2563 


© No significant difference between the average performance of girls and boys. 
© Rural students’ average performance is significantly greater than that of urban students. 
» Rural students! average performance is significantly lower than that of the urban students. 


[ Table 6.14: Average EVS scores, by location, for states where class VI students were tested | 


| Maharashtra 


| iroup Average 


| Jharkhand 
Meghalaya 


Nagaland 


West Bengal 
Group Average 


© No significant difference between the average performance of girls and boys. 
© Rural students! average performance is significantly greater than that of urban students. 


6.2.3 Are there any differences in EVS achievement related to caste category? 


Table 6.15 compares the average EVS scores achieved by students in different social categories. It shows that within 


this group of states, no significant difference was detected in the average achievement levels of students in the SC and 
ST categories. Students classified as being in the OBC category significantly outperformed those in the ST category. 


On an average, students in the General category achieved significantly higher scores than those in other categories. 
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Table 6.15: Average EVS scores for groups by social category (class V) 


e The average scores of the two categories being compared are not significantly different. 
O The average scores of the category given in the first column is significantly higher than that of the category with which it is being compared. 
© The average score of the category given in the first column is significantly lower than that of the category with which it is being compared. 


6.3 Conclusion 


The average achievement of students in EVS varies greatly across the states and UTs of India. There is a highly 
significant difference between outcomes in high scoring states such as Tamil Nadu (288), Uttar Pradesh (284) and 
Karnataka (275) and low scoring states/UTs such as Puducherry (222), Chandigarh (226) and Haryana (232). 


States also vary greatly in the range between their lowest and highest achieving students as revealed by their inter- 
quartile score ranges. Some states/UTs, e.g., Chandigarh (38), Puducherry (43) and Sikkim (44) have relatively 


homogeneous cohorts whilst others have far more diverse outcomes, e.g., Uttar Pradesh (89), Karnataka (84) and 


Madhya Pradesh (83). 


Overall, no significant differences were detected in the average achievement of girls and boys. Similarly, no significant 
difference was detected between the achievement level of rural and urban students. 


The survey did find that students from the General Category outperformed their peers in the SC, ST and OBC 


categories by a statistically significant margin. 


The following chapter provides more information about what class V students at various levels of achievement know 
and can do in the domain of Environmental Studies. 
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1 Chapter 7 
Environmental Studies: What 
Students Know and Can Do 


CHAPTER 7 ENVIRONMENTAL STUDIES: 
WHAT STUDENTS KNOW AND CAN DO 


1 Overview of the Environmental Studies Tests 


c EVS tests given to class V students consisted of three test booklets, each containing 40 multiple choice items. 
e items were chosen keeping in view the whole range of the content. Out of 40 items, 20 items were common 
oss all test forms. These served as ‘anchors’ so that the different test booklets could be linked together and hence, 
items could be placed on a common scale (See below). In addition, each test form contained an extra, 20 unique 


ms. Thus, altogether the EVS tests used in the survey comprised 80 items. 


e items were designed to test a range of relevant cognitive processes or ‘skills’. These are classified as knowing, 


plying and reasoning as defined below: 


Cognitive Processes for Environmental Studies 


Knowing (Skill 1): In items testing this process, students are expected to recall or recognise terms, facts, symbols, units, and basic 
scientific/social concepts. They select appropriate apparatus and measurement devices for conducting experiments/investigations. 


Applying (Skill 2): The items in this cognitive domain are designed to involve the application of knowledge and understanding 

in straightforward situations. The items testing ‘applying’ require students to compare, contrast and classify, and to interpret 
nformation in light of a concept. Students are also expected to use and apply their understanding of concepts and principles in the 
known situations. Simple, i.e., single step problems requiring a numerical solution are also included. 


Reasoning (Skill 3): In items testing ‘reasoning’, students need to demonstrate their ability to solve problems, draw conclusions 
and make decisions. For this, students are required to analyse a problem (perhaps in new situation), identify relationships, 
determine underlying principles, devise and explain strategies for problem solving. 


7.2 Item Mapping 


Following testing, the responses of students to the various tasks were analysed using Item Response Theory (Appendix 
II). The three test forms were then aligned using the anchor items, thereby placing all items on a single scale 


comprising scores from 0 to 500. On this scale, the mean score was set at 250 with a standard deviation of 50. 


Calibrating the items according to their levels of difficulty places them on an ‘item map’ with the more demanding 


items at the top and the easiest items at the bottom. Such item maps give us a picture as to what students at different 


levels of ability know and can do. 
The item map for EVS is given below. The scale score in the first column shows the level of difficulty for 


each item. Perhaps more importantly, 
for a student to have an even chance of success on the item. The map also includes a brief description of what 


.e., each item is classified according to the cognitive process being 


this score also represents the minimum score on the ability scale necessary 


students needed to do to answer the item correctly, i 


evaluated. 
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Table 7.1: Item map in EVS 


Scale Score Mental Processes Question Description 
351 Applying Understand the phenomena of lunar eclipse 


338 Know the importance of forest in human life 
333 


Establish relationship between measuring apparatus and quantity of water 
302 Applying Find the effect of exhaled air on mirror 


(no item appeared at this difficulty level) 


| Knowing | Know the sources of energy and their by products 


Know the components of food/diet and their functions 


Applying Understand the process of breathing 
217 Applying Find out the least polluting fuel on the basis of their combustion 


300 
296 
290 
284 


Establish relationship between wind strength and flags' position 

Applying Reason out the importance of wild animals in ecosystem 
264 
263 Reasoning Reason out to find the direction in the map 


260 Knowing | Know about the neighboring countries of India 
[ xe [ Knowing  KowHeeibepatofaamt O] 
Interpret the graph to find out heartbeats of the mouse 

251 Reasoning Explain the reason behind the construction of dams à 
Interpret the graph to find out rainfall on Wednesday 

24 


Understand the family tree and interpret the relationship 
| Knowing | Know the animal source of food 

Establish relationships on the basis of family tree 

| Knowing | Know the sources of water and their usage 

Relate different types of clothes with their properties 
Interpret the graph to identify the animal that has lowest heartbeats 
Apply knowledge to find the direction in the map 

| knowing | Know the suitable conditions for breeding of mosquitoes 
Find out solution for patient when doctor is not available 
Compare the means of transportation causing pollution 
Interpret the graph to find out the most rainy day 


Know the national game of India 


| Teitem appeared at this difficulty level) 


Know the properties of solutes and solvents 


240 
237 
234 
231 
228 
224 
218 
215 
213 

211 


| Knowing [Knowthenameofdisease spread by mosquitoes 
1 Classify the group of domestic animals 
172 Recognise birds on the basis of their features 
Note: Percent correct values from classical test theory are given in Appendix IV. 


185 
82 


The map shows that class V students demonstrate a wide range of ability in the domain of EVS. 


Students at the lower end of the scale, i.e., those with scale scores in the range of, say, 170 to 225 can demonstrate 
all three cognitive processes—provided that the context is clear and the tasks non-complex. For example, they are 


able to use information from a table to locate the places and direction in the map, to classify animals and plants on 
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the basis of their specific characteristics, to recall the disease spread by mosquitoes and suitable conditions of their 


spreading, to identify living organism on the basis of their features, habits and habitats etc. 


rudents performing in the intermediate range of the scale (say, 225 to 275) can do more. In addition to that 
scribed above, they can analyse the issues, interpret information, establish relationships, relate information, and 
| out solutions in different situations. They can also locate places in the map, reason out the construction of a dam 


They can also identify cause and effect relationships and make inferences in various situations. 


lents performing at higher end of the scale, i.e., those with scale scores above, say, 275 can do more. In addition 
:t described above, they know and can explain the components of diet and their functions, sources of energy 
their by products, and the importance of forest in human life. They can also establish relationships, and explain 


ical effects, e.g., exhaled air on a mirror, the phenomena of lunar eclipses etc. 


| Sample Items 


“ems reproduced below were used in the tests of EVS. Statistics showing how students responded to these items are 


n. These items are arranged in increasing order of difficulty. They can also be located on the item map. 


«mple item: Knowing Scale score: 172 
m 61. Which of the following birds can NOT fly? 


1. Parrot 
2. Crow 
3. Eagle 


4. Ostrich 


© item requires students to recall the bird that cannot fly. The scale score of this item was 172, i.e., significantly 
low the average level of difficulty of items in the survey. As many as 81% of students in the sample were able to 


lect the correct answer (4). The figure shows how the remaining 19% responded. 


3 Figure 7.1 (Item 61): Percentage of students in each response category | 


Omitted 


Sample item: Knowing Scale score: 256 


Item 33. Which part of the carrot plant is eaten? 
1. flower 
2. leaves 
3. stem 


4. root 
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This item requires students to recall the edible part of carrot. The scale score of this item was 256, i.e., very close to 
the average level of difficulty of items in the survey. Almost 49% of students in the sample were able to select the 


correct answer (4). The figure shows how the remaining 51% responded. 


| Figure 7.2 (Item 33): Percentage of students in each response category | 


a 


Omitted 


Sample item: Knowing Scale score: 296 


Item 44. Which one of the following sources of energy produces carbon dioxide? 
Solar energy 

2. Energy from coal 

3. Wind energy 

4. Hydrothermal energy 


_ 


This item requires students to identify the source of energy which produces carbon dioxide. The scale score of this 
item was 296, i.e., above the average level of difficulty of items in the survey. Only 36% of students in the sample 
were able to select the correct answer (2). As many as 62% students chose the wrong options. Out of 62%, 26% 


students selected option ‘1’ and 24% opted “3”. It means that the options 1 and 3 worked as good distracters. Hence, 
the item proved to be quite difficult. 


Figure 7.3 (Item 44): Percentage of students in each response category 
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{tem 3. Which of the following groups contains only domestic animals? 
1. tiger, lion, leopard 
2. cow, dog, cat 

3. crow, peacock, owl 
4. deer, bear, cheetah 


This irem requires students to classify the group of domestic animals. The scaled score of this item was 182, i.e., 
be ow the average level of difficulty of items in the EVS survey. As many as 79% of students in the sample were able 
ect the correct answer (2). The figure shows how the remaining 21% responded. 


Figure 7.4 (Item 3): Percentage of students in each response category 


Fa 


Millimetres (mm) 


Monday Tuesday Wednesday Thursday Friday Saturday Sunday 


Sample item: Applying Scale score: 249 
Item 9. What was the rainfall on Wednesday? 
1 8mm 
2. 7mm 
3. 5mm 


4. 4mm 
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This item requires students to interpret the given graph and find out the measurement of rainfall on Wednesday. 
The scale score of this item was 249, i.e., very close to the average level of difficulty of items in the survey. Around 


50% of students in the sample were able to select the correct answer (2). The figure shows how the remaining 50% 
responded. 


| Figure 7.5 (Item 9): Percentage of students in each response category | 


Lil. 


Omitted 


Item 49. A aa of the mirror clouds up when you breathe on it because of 
1. water vapour from your breath 
2. carbon dioxide from your breath 
3. oxygen from your breath 

4. nitrogen around you 


The item requires students to explain the effect of exhaled air on the mirror. The scale score of this item was 302, i.e., 
significantly above the average level of difficulty of items in the survey. Only 36% of students in the sample were able 
to select the correct answer (1). The figure shows how the remaining 64% responded. It is clear from the figure that 


options 2nd and 3rd worked as strong distracters. Perhaps, students thought that carbon dioxide and oxygen were 
also present in the air. Hence, the item was hard in nature. 


Figure 7.6 (Item 49): Percentage of students in each response category 
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Direction: Family tree of Meena is shown below. Based on the figure, answer the questions 45, 46 and 47. 


Bimla Dinanath 
(Mother) (Father) 


Sunita Rakesh 
(Sister) (Brother) 


mple item: Reasoning Scale score: 234 
146. Rakesh and his wife are blessed with a son. What will be the son's relationship with Dinanath? 
1. Grandson 

2. Son 
3. Brother 
4, Brother-in-law 


his item requires students to find out the relationship on the basis of information given in the family tree. The scale 
core of this item was 234, i.e., below the average level of difficulty of items in the survey. As many as 58% of students 


n the sample were able to select the correct answer (1). The figure shows how the remaining 42% responded. 


Figure 7.7 (Item 46): Percentage of students in each response category 


Omitted 


Scale score: 240 


Item 45. Rakesh gets married. What will be the relation of his wife with Meena? 
. Sister 
. Sister-in-law 
. Mother 
. Daughter-in-law 
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This item requires students to think about the relationship as per information given in the family tree. The scale score 
of this item was 240, i.e., close to the average level of difficulty of items in the survey. As many as 54% of students in 
the sample were able to select the correct answer (2). The figure shows how the remaining 46% responded. 


Figure 7.8 (Item 45): Percentage of students in each response category 


1 


54 
15 
2 12 
4 
1 2 3 4 


Omitted 


Sample item: Reasoning Scale score: 250 


Item 47. Rakesh is transferred to some other place and lives like a nuclear family. 
Now how many members are staying in Meena’s family? 
4 


d: 

25 
3106 
h. T 


of this item was 250, i.e., the average level of difficulty of items in the survey. As many as 5196 of students in the 


This item requires students to analyse the situation and find out the number of persons in the family. The scale score 
) sample were able to select the correct answer (1). The figure shows how the remaining 49% responded. 


Figure 7.9 (Item 47): Percentage of students in each response category 
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Performance on the sample items reproduced here varied across the country. Table 7.2 shows the proportion of 
students in each state or UT correctly responding to each item. The states/UTs are grouped according to the language 


in which the EVS tests were presented as some variation in performance may be due to translation effect. 


Table 7.2: Performance on the sample Items in states and UTs 


ll ie 


| All sample 


| Tripura a a aa aa 
| West Bengal*" | Bengali | 90 | ss | 69 | 2 | e | rv | 66 | » | 9 | 
[A&N Islands oa ao 

Chandigarh | English | 6 | 49 | m» [| um | e [ s [ w | 29 | es | 
| Goa* Le pogc[ok ew Truc A ECO wp» | 
Meghalaya” — | Engish | 3 | 39 | so | 35 | w | uw | w [ wm | 1 | 


Ngaand — [ Engish [ v | 9 | 56 | » | » | 9 | » [ 36 | vm | 
Sikkim** | English | ss | a | wc | m | w | w | 36 | 25 | s | 
Gujarat | Gujarati | si | 59 | 9 | sa | 8 | 30 | w6 | 2 | mw | 
Daman &biu* | Gujarati | 79 | a | 2 | s» | nm | a | s | 2 | 16 | 
Bihar AMARO a aa a A 
Chhattisgarh — | Hindi | o | w | 46 | 34 | w | 60 | ue | uo | 6 | 
Delhi pcs E E e AOS EC | wow Tow 
Haryana MARAT See ase O x | sw 
Himachal Pradesh | Hindi | 76 | 45 | 39 | 30 | w | se | s | » | s | 
Madhya Pradesh | Hindi | 93 | 60 | 68 | 5 | 59 | w | se | 36 | s | 

(Rajasthan [ Hindi | vr | s | w | w | 5 | 6 | s | s | e | 

| Uttar Pradesh — [ Hindi | s | 65 | o4 | & | 66 | m | 68 | s | s | 

(Uttarakhand — | Hindi | B | us | w | 3 | w | 9 | ww | 26 | | 

pmmkand — | Hindi | o | 5» | 9 | w | | s | e | » | m | 

Kamataka | Kannada | 86 | 64 | 5 | » | 8 | om | 2 | 5 | 8 

| Kerala* | Malayalam | 89 | & | x | m | o | 66 | sg | so | s | 

|Maharashtra* | Marathi | 86 | ws | 2 [ 35 | 5 | e [| 5 | s | s 

| Mizoram” — | Mz | er | se | é | m | ss | se | 68 | 38 | 9 | 

[Orsa AA E AN ag ON O O ENSURE ONCE 
Punjab | Pmjb | n | 36 | so | 26 | s» | s | w | 2% | 9 | 
Puducheny Ups usce a A ESA E wg A 
Tami Nadu | Tami | 9 | vm | n | 60 | n | 6 | m | s | e | 
[Andhra Pradesh | Telugu | 7 | 48 | m | 29 | o| e | w| 39 | em 
[sume —— a | 9 | s | om | 3 | 8 NA AA NA AA AA AA T 
Jammu 8 Kashmir | Multiple | m | 56 | 56 | 5 | ss | 6 | we | a | m | 


1. States/UTs marked * achieved samples representing <80% of the target population. 


2. States/UTs marked ** tested students in Class VI. 
3. Assam tested students in Assamese and Bengali. Jammu & Kashmir tested students in English, Hindi and Urdu. 


7.4 What can students do in EVS? 


In this chapter it has already been mentioned what the students performing at different levels of content domain on 


EVS items can do. The items in EVS were developed on the following content areas: 
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Family and Environment 
i) Family life 

ii) Work and play 

iii) Animal life 

iv) Plant life 


Food 

i) Food hygiene 

ii) Preservation 

iii) Cooking 

iv) Eating habits 

v) Nutritional deficiencies and related diseases 


vi) Sense of taste and digestion 


Shelter 

i) Different types of housing 

ii) Need for sharing resources and space 
iii) Neighbourhood and community living 


iv) Times of emergency 


Water 

i) Sources of water and irrigation 
ii) Animals and plant life in water 
iii) Floating and solubility in water 


iv) Stagnant and flowing water 


Travel 

i) Fuels used in vehicles 

ii) Renewable and non-renewable energy 
iii) Travelling in the mountains 

iv) Expedition and spirit of adventure 


v) Different modes of transport 


Real Life 

i) ‘Things we make and do 
ii) Children’s ideas 

iii) Observation reports 

iv) Expression of experiences 


v) Process of experiment 
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Given below are the tables showing the performance of students of class V on various cognitive processes or skills on 


different content areas. 


7.4.1 Family & Environment 


4 Table 7.3: Performance of class V students on the content area of Family and Environment | 
npoing i) 


Knowing (Skill 1) 


Er 
E m7 
T 250 
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Knowing (Skill 1) 
m Around 80% students in the country know the name of the bird (ostrich) which cannot fly (Item 61). 


m About half of the students can relate characteristics of plants with their habitat (Item 11). 


Applying (Skill 2) 
m Nearly three-fourths of the students can classify the animals in two groups, i.e., domestic and wild animals (Item 
3) and can identify the footprints of birds (Item 19). 


m Only 41% students are able to know the relationship between inhaling and exhaling of air and expansion of 


chest (Item 43). 


Reasoning (Skill 3) 
m Nearly 60% students can reason out that the larger animals have low heartbeat per minute as compared to 
smaller size animals (Item 50). 


m About one-third students can explain the benefits of forests for human beings (Item 70). 
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7.4.2 Food 


[> Tables Performance of dass V students on the content area offood | 
Reasoning (kil 3) 


Knowing (Skill 1) 


m About 50% students know about the best source of iron (Item 1) and the cause of night blindness (Item 12). 


Applying (Skill 2) 
m More than half of the students can identify the foods that come from animals (Item 76). 


m Less than one-third students in the country can select the food material which can give energy to human body 
(Item 48). 


Reasoning (Skill 3) 
m More than half of the students can reason out that it is safe to wear cotton clothes rather than silk, nylon and 


terricot clothes while cooking food (Item 22). 


7.4.3 Shelter 


Table 7.5 : Performance of class V students on the content area of Shelter 


Knowing (Skill 1) 
m Nearly two-thirds of the students know how to find the solution in a given situation (Item 14). 


Applying (Skill 2) 


m Nearly half of the students can relate the different types of roofs with geographical condition and can also 
explain the reason behind the construction of dams (Item 24, 32). 


Reasoning (Skill 3) 


m About half of the students can reason out that population explosion is the root cause of unemployment and 
housing problems in India (Item 28). 
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7.4.4 Water 


| Table 7.6: Performance of class V students on the content area of Water | 


| scale value | Scared | Homo | scale value | ‘correct | 1em No | Scale value | % corea | 
EG ë ë EE —— = —— 
—— — ——— 


Knowing (Skill 1) 


W About three-fourths of the students know about the diseases spread by mosquitoes (Item 13) and the animals 


that can live both on land and water (Item 42). 


Applying (Skill 2) 
= More than half of the students know the sources of water and its usage (Item 20). 


m Nearly three-fourths of the students know that salt can dissolve in water (Item 55). 


Reasoning (Skill 3) 


m Nearly three-fourths of the students in the country can interpret the given graph and find out the particular day 
on which maximum rainfall occurred (Item 8) and know about the best usage of water (Item 38). 


7.4.5 Travel 


Table 7.7: Performance of class V students on the content area of Travel 
Knowing (Skill 1) Applying (Skill 2) Reasoning (Skill 3) 


[Item No | Scale value | %correct [tem No | Scale value | % correct | item No | Scale value 
Lh” — 9 EM — — — NEM — 
pos o EM 
x 
| EX —— 
| ——— 

— o — 


Knowing (Skill 1) 


m Less than half of the students know about the forms of energy commonly used at home (Item 15). 


Applying (Skill 2) 
m About two-thirds of the students in the country understand that motor driven vehicles cause more pollution as 


compared to non-motor driven vehicles (Item 54). 


m Only one-third students know about the sources of energy which produces carbon dioxide (Item 44). 
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Reasoning (Skill 3) 


m More than half of the students know the reason that Earth looks bluish in colour when seen from the outer space 
due to the oceans (Item 25). 


7.4.6 Real Life 


| Table 7.8: Performance of class V students on the content area of Real Life 


Reasoning (Skill 3) 
| Memo | Scale value | % correct | Item Wo | Scale value | % correct | MemNo | Scale value | % correct 
| v | o» BEN » 


Knowing (Skill 1) 
m Nearly half of the students know about the instrument used for measuring the body temperature (Item 73) 


m Only 3096 students know that lunar eclipse occurs when the earth is between the sun and the moon (Item 16) 
Applying (Skill 2) 


m About half of the students can identify the substances which cannot absorb in water from the given picture (Iten 


74). 
m Only 26% students can relate the measuring apparatus with the quantity of water (Item 23). 
Reasoning (Skill 3) 


m More than half of the students can reason out that paint does not dissolve in water but it dissolves in kerosene 


(Item 56). 


m Less than 40% students know that it is the water vapour that clouds the mirror when we breathe on it (Item 49) 
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Student-related Variables 


CHAPTER 8 STUDENT-RELATED VARIABLES 


Part I-Profile 


[he majority of results in this chapter relate to the total respondents to the student questionnaire without weighting. 
Overall figures are reported, as well as some illustrative results from individual states/UTs. It should, however, be 
noted that in five states/UTs— Assam, Daman & Diu, Goa, Kerala and Maharashtra—the population coverage 
fell below 80% mainly due to the Upper Primary Only school exclusion (see Chapter 1). Some results connect the 
background variables with test scores on the three subjects. In this situation, results refer to approximately two- 
thirds of respondents with both background factors and test scores on the relevant subject. Again, these results are 


presented without weighting. 


‘The data in this chapter is derived from questionnaires completed by 1,17,653 students studying in 6,411 schools of 
274 districts of 31 states all over the country. This chapter covers detailed information on the students and school- 


related variables which have been categorised as follows: 
m Students’ background 

BW Resources available at home 

W Resources available in school 


W Students’ activities outside the school 


In the tables and figures of this chapter, standard errors are reported in brackets along with relevant statistics unless 


otherwise mentioned. 


8.1 Students’ Background 


‘The variables covered in this category are gender, social groups, language used at home and school, number of 


siblings, and whether they are physically challenged etc. 


8.1.1 Student Gender 


The gender distribution of students is given in Figure 8.1. Overall the sample comprises 49% boys and 51% girls. In 
Appendix VII, Table A-7.1 gives the percentage of sampled boys and girls by state. 


- Figure 8.1: Gender of Students 


M Boy Girl 
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8.1.2 Category distribution of students 


The Government of India has officially documented castes and sub-castes, primarily to determine those deserving 


reservation in education and jobs. The whole population is divided into four caste categories — SC, ST, OBC and 
Others. Figure 8.2 shows that 20% of those in the survey were SC students, 19% ST students, 32% OBC students, 


and 29% Other students. 


Figure 8.2: Student categories 


MSC MST MOBC MW Others... 


8.1.3 Language used at home 


Teaching to students in their mother tongue is emphasised by the government and policy makers. Figure 8.3 shows 
the percentage of students speaking the same language at home as the one used in the school. As many as 66% 


of students reported that they spoke the same language at home and remaining 34% of students used a different 
language. 


Figure 8.3: Language usee in home 


EH Yes B No 


8.1.4 Number of siblings 


Figure 8.4 shows the percentage distribution of number of siblings, categorised into having no sibling, one sibling, 


two siblings and three and more siblings. Around 52% of students had three or more siblings and 9% of students 
had no siblings. 


Student-related Variables 


Figure 8.4: Number of siblings 


BO Mi M2 M3ormore 


8.1.5 Physically challenged students 


Figure 8.5 indicates that 7% of students were physically challenged. 


E No E Yes 


8.2 Resources Available at Home 


Students with more educational resources tend to attain better than those who do not. This survey focused on some 
of the variables such as parents' level of education, their occupation and resources available at home that facilitate 


learning of the students. 


8.2.1 Educational status of parents 


Parents are the first teachers of the students and they play a pivotal role in the achievement of their children. Figure 


8.6 describes the educational status of the parents of class V students. 


Figure 8.6: Parental education 


Illitrate 16 
Literate / Primary 41 
Secondary 37 
Graduate and above 6 
Dont know / Not applicable 5 
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8.2.2 Parents’ occupation 
In this survey, occupations have been grouped into broader categories. Figure 8.7 provides the distribution of students 
on the basis of their parents’ occupation. Results reported were unemployed (12%), housewives (2%), agricultural 


labourer/servant/vendor/ street labourer (35%), farmer (22%), skilled/office worker/ shopkeeper/businessman 


(24%), teacher/professor/manager (4%). 
Unemployed 

Housewife 

Agri labour/Servant etc. 

Farmer 

Skilled/ Office/ Business 


Teacher/ 
Professor/Manager 


8.2.3 Below Poverty Line (BPL) card 


The Poverty Line is an economic benchmark and threshold used by the Government of India, but varies between 
states, to identify individuals and households in need of government assistance and aid. Overall, 4796 of students 
reported their family had a BPL card and 2196 of students do not know (Figure 8.8). 


| 


MYes MNo MDontKnow 


8.2.4 Literacy resources at home 


In view of the importance of literacy resources in enhancing the learning of the students, information was sought 
about the availability of some literacy resources, e.g., calculator, computer, study desk, dictionary, internet, daily 


newspapers and magazines at home. A wide variation from study desk (49%) to internet access (7%) was observed. 
These are shown in Figure 8.9. 
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Figure 8.9: Resources in home 
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3.2.5 Books at home 


[he availability of books at home has been categorised into having no books, 10 books, 11-25 books and more than 
5 books. Figure 8.10 shows that 40% students reported having no books in their home and the highest percentage 
11%) of students reported having 1-10 books. Only 11% reported having more than 25 books and 8% had 11-25 


»ooks. 


Figure 8.10: Books in the home 


MNobook M1-10 1811-25 M More then 25 


8.3 Resources Available in School 


Schools are almost like a second home for the children as this is the place where they spend one-third of their time. 


This survey has covered some of the important variables like what they think about their school, teaching and 


learning processes in the school, etc. 


8.3.1 Teaching and learning process 


Teaching and learning process includes many activities inside and outside the school. Some of the variables which 


play a significant role in the process such as homework, textbooks and activities important for teaching have been 


covered. 


8.3.2 Help in studies 


Figure 8.11 shows the percentage of students gerting help from different quarters. More than 58% of students 
reported getting help in their studies from different members of their families such as father (66%), mother (58%), 
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elder brother and sister (69%), and 32% of students reported that they did not get any help from anybody. Around 
44% of students reported getting help from tutor. 


| Figure 8.11: Help with homework | 


66 69 


58 


43 


32 


Father Mother Eldersib Tutor None 


8.3.3 Private tuition 


Taking private tuition is a common practice nowadays. Keeping in mind that quality education should be provided 
by the teacher in the classroom, government has restricted the school teachers from providing tuition. However, it 


exists in one way or the other in response to parental demand. Figure 8.12 shows that overall, 31% of students said 
they were taking private tuition. 


Figure 8.12: Private Tuition 


B Yes E No 


8.3.4 Having textbooks 


Not much variation was found across the states. Overall, at least 97% of students reported having textbooks of each 
of the three subjects (Figure 8.13). 
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Figure 8.13: Have textbook? 


97(0.1) 98(0.1) 97(0.1) 


Language Mathematics EVS 


8.3.5 Students” attitude towards school 


Students were asked about their likes and dislikes about school. On an average, over 90% reported that they liked to 
be in school and that their teachers wanted them to do their best. About 81% of students said that students in their 
school tried to do their best. 


8.4 Students” Activities outside the School 


All-round development of the students comes not just from what they learn from the school but also from activities 
outside the school. The survey gathered information on some of the important activities outside the school, such as 
their reading habits (books, newspapers, magazines), watching television, interaction with their friends, discussion 
with their friends about the lessons in the school, sharing with their parents what they learn in school, helping family 
members by doing household chores, and how often they mixed with their peer group. 


The data indicated that daily, nearly 67% students watched TV, 78% interacted with their friends, 82% played 
sports/games, 33% read books for enjoyment, 81% did the homework given at school and 64% shared with their 


family what they learnt in the school. As many as 75% of students never used a computer outside the school. 


When asked about helping in the household chores, about 69% of students reported that they looked after the 
family members, 62% helped in cleaning the house and 32% helped in preparing food daily. 


Part II-Student Background and Attainment 


Home background is a crucial factor in the development of intellectual abilities. These can include personal 
characteristics that affect the way a young persons abilities can progress, such as gender, geographical region and 
social labels such as caste. Chapters 2, 4 and 6 of this report have already indicated for different subjects the apparent 
lack of an overall effect of gender and region, and the substantial effect of caste on performance of the students. 


It is also true worldwide that socio-economic circumstances and the correspondence of the home language and the 
language of school instruction have a major effect on the success of individuals in the education system (OECD, 
2010). In all the analyses in this chapter, the relation with aspects of these is considered on its own. An index of 


socio-economic situation is then derived from a combination of such background factors. 
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Because of their importance to educational success, socio-economic status and language together are described as 


“key variables’ and the following method of analysis is adopted: 


m First, the raw relation (‘bivariate’) between the background variable and the outcome, in different subjects, is 


presented and then the relation is presented after allowing for these two ‘key’ variables. 


m One category, usually the largest, is designated as a ‘base’ category and assigned a zero value, and all other 
categories are defined in terms of their difference from the base result. 


m Since these key variables are a very important aspect of attainment, it often, though by no means unfailingly, 


happens that including such other key variables in the regression means that the apparent univariate relationship 


is diluted. 


If a relation between a factor and an outcome is not extinguished by making such allowances, it is reasonable to 
suggest that the factor is having an effect on the outcome. 


The information in this chapter comes from the pupil questionnaire. Some studies of student attainment include a 
parental questionnaire, but, while further information on parental practices in encouraging education would have 
been of interest, it is important to bear in mind that the primary focus of this study was not to explain differences 
in attainment, but to compare the levels of attainment of entities in the national system, and hopefully, to lay the 
foundation for a comparative series investigating the progress of attainment over time. The study was also primarily 
a very ambitious school-based exercise, and so practicalities meant that contacting large numbers of parents for 
this purpose would not have been feasible. Activities related to academic learning and students’ characteristics were 
considered for analyses. 


8.5 Socio-economic Index 


The first ‘key’ variable is socio-economic index in which literary and other resources at home were combined to form 
an index of socio-economic resources. The details of its construction are described more fully in Appendix V. It is a 


weighted combination of parental education, parental occupation, number of possessions, and number of books at 
home. 


8.6 Language Spoken at Home 


The second ‘key’ variable considered is speaking the language of instruction at home. It is to be expected that 


students familiar with the language used will find coping with the day-to-day business of school easier, and are likely 
to make more progress. 


8.7 Treatment given to Variables used in Analysis 


‘The variables considered under the pupil background are as under: 
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Table 8.1: Pupil-related variables and its treatment for regression variables 


Homework checked at | a) Family member, b) Tutor, c) Friend, d) None ‘NONE’ as a base category 
home 

a) Family member, b) Tutor, c) Friend, d) None ‘NONE’ as a base category 
Read material other a) Read comic books, b) Read stories or novels, c) Read books that As quasi-continuous variables 
than course material explain things, 


Activities outside the | a) Watch television or videos, b) Work with computer, c) Interact with | As quasi-continuous variables 
school friends, d) Play sports or games, e) Read a book for enjoyment, f) Use 


the internet, g) Do your homework, h) Discuss with your friends what 

you learned in school, i) Tell your family about what you learned in 

school 
Attitude towards LANGUAGE: a) You enjoy learning Language, b) Language is easier for | Sum of agree responses to the 
subject you than other subjects, c) Language is easier for you than for other questions 

students, d) You read silently on your own 

MATHEMATICS : a) You usually do well in mathematics, b) You would 

like to do more mathematics in school, c) Mathematics is harder for you 

than for many of your classmates 

EVS: a) You usually do well in EVS/Science/Social Science, b) You would 

like to do more EVS/Science/ Social Science in school, c) EVS/Science/ 

Social Science is harder for you than for many of your classmates, d) 

You like to ask questions in your EVS/Science/Social Science class, e) You 

learn things quickly in EVS/SciencelSocial Science, f) EVS/Science/Social 

Science is boring, g) You enjoy learning EVS/Science/Social Science, h) 

Your teacher asks questions in the class 


8.8 Student Background Factors 


8.8.1 Gender-wise 


Table 8.2: Regression results - Gender-wise 


Without key variables | Giris | 
With key variables | Girls | 


*Significant if P«.05 , **Significant if P<.01, NS-Not Significant 
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Table 8.2 indicates that only in Mathematics do boys appear to do better than girls. The coefficient of -1.70 means 
that, on average, girls scored 1.70 scale score points less than the boys. This difference is small but, for this subset of 
the population, it is statistically significant. In the case of Language, girls in this sample performed better than boys 
by a small but statistically significant margin. In EVS, there is no significant difference in the performance of boys 


and girls. The same trends were observed after entering the key variables. 


8.8.2 Category-wise 


Table 8.3: Regression results — Category-wise 


SMe a ARA 
Segoe = 

Ts  — Zo s ^  EEH — 
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"Significant if P<.05, **Significant if P<.01, NS-Not Significant 


With key variables 


Table 8.5 reveals that the SC and ST category students significantly underperformed as compared to students of 
‘Others’ category in all the three subjects. The same trend is observed with key variables. 


In case of Language only, the students of OBC category poorly performed as compared to students of “Others 
category without key variables only. However, with the key variables, the difference was not significant. 


8.8.3 Siblings-wise 


The number of siblings a child has is likely to affect the amount of attention which his or her parents can accord, 
though to some extent, this can be offset by the other members of the family. It is also likely to affect the amount 


of other resources available to each member. Table 8.4 shows the relationship between number of siblings and 
attainment in different subjects. 


Table 8.4: 


Regression results - Siblings-wise 


Variables language imc A | 


MAA ANA EA 
without ey variabies | ar | oz | * | om | oz [| * | am] os | * ] 
[wth key votes | oso | on | = | oo | ox |] ett 


"Significant if P<.05 , **Significant if P«.01, NS-Not Significant 


Table 8.4 shows that for each additional sibling, there is, on an average, 


a decline in attainment of 1.87, 0.44 and 
1.04 scale score points in Language, Mathematics and EVS respectively. The size of this relationship is reduced, 


though not removed, by allowing for key variables, suggesting that some of this difference may be due to scarcity of 
resources. 
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8.8.4 Physically challenged 


Table 8.5: Regression results = Physically challenged students 


| Gef | se | sig | Gef | st [ sig | cor | se [ sig | 
EE ve NAN 
ar 115 [EN] a | w ]|-05 | 169 | W | 


nificant if P«.05, **Significant if P«.01, NS-Not Significant 


Without key variables 
With key variables 


: evident from Table 8.5 that pupils classified as physically challenged performed substantially low than the rest 
he students both without and with key variables in all the three subjects. 


ysically challenged students do substantially worse than the rest of the population, suggesting that more could be 
:e improve their access to education. 


.8.5 Mode of conveyance 


An important aspect of school attendance is, naturally, getting there. Unfortunately, the question on length of time 
) get to school gave some difficulties to respondents, and it has not proved possible to use the responses to this 
uestion. Students were also asked what means of transport they used to get to school. 


Table 8.6: Regression results - Students using different modes of conveyance | 


| Without key variables 


| With key variables 


NE NE 
EM EEE 
[5.00 | 205 | * | 
[ 3m | 2:0 | M | 
[OMNEM 
E o ees 
| 35 | ELSE 
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Significant if P«.05 , "signifiant if P«.01, NS-Not Significant 


Table 8.6 indicates that the mode of conveyance to school does not impact the achievement level of students 
substantially. In Mathematics it was seen that the students using bus as a means of conveyance underperformed 


significantly than the students who walked to school. 
In Language, students using other means to attend the school do slightly better, but this is halved for bus and 


other, and disappears entirely for bicycle transport after allowing for key variables, suggesting that much of this 
apparent difference may be due to resources. However, in EVS, students using bicycle to attend the school performed 


significantly lower than the students who walked to school. 


The trend in different subjects clearly indicates that the performance of the students who walked to school was better 


than those students who are using other means of conveyance. 


8.8.6 Subject textbooks 


One other important resource is a textbook in the subject. 
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Table 8.7: Regression Results - Students having subject textbooks 


[ Gef | st | sg | Get | se | sig | SECIN 
[Without key variables | 846 | 15 | ** | mg | 28 | ** | & 
[with key variables | ms | wo | * | mm | zm [ * [es | 209 | 


*Significant if P«.05 , **Significant if P«.01, NS-Not Significant 


Students who do not have a textbook in the subject performed poorly as compared to those who have a textbook in 


all the subjects. 


8.8.7 Attitude towards subject 


Having a positive attitude to the subject is related to better performance. 


Table 8.8: Regression results - Students attitude towards different subjects 


EVs 
| Geff | se | sig | (eff | se | sig | (off | SE | 
| Without key variables | 3. | 036 | ** | asm | o | ** | 319 | ox | 
[With key variables | 316 | o35 | ** | 268 | oz] | * | 30 | 026 | 


*Significant if P<.05, **Significant if P<.01, NS-Not Significant 


Variables 


Positive attitude of students towards different subjects has shown positive impact on their achievement. 


In each case, better performance accompanies more positive views. Allowing for resources has little effect. 


8.8.8 Getting help in studies 
Table 8.9: Regression results — Students getting help in studies 


Without key variables 
With key variables 


"Significant if P<.05 , **Significant if P<.01, NS-Not Significant 


From Table 8.9 it can be seen that there was positive impact of getting help in studies from the family members on 
achievement of students in all the three subjects without including key variables. 


8.8.9 Taking private tuition 


Table 8.10: Regression results - Students taking private tuition 


Variables 


[ $& [ sp | mer] s [ sg | aer | s [ 5g 
[Wihout keyvariabies | -083 | ose | w | om | ose | M | am | ox | w 
[win hey aribles | 365 | o5 | +] on [| 


-0.84 
*Significant if P<.05 , **Significant if P<.01, NS-Not Significant 
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From the table it can be interpreted that private tuition did not have significant effect on students’ achievement 
without key variable. However, after allowing for key background variables, it was seen that pupils who had a tutor 
do well in Language and EVS. 


8.8.10 Homework checked at home 


Table 8.11 Regression results — Students getting homework checked at home 


ificant if P«.05, **Significant if P«.01, NS-Not Significant 


enerally it is thought that pupils who have their homework checked at home would do better than those who don't. 
e survey confirms the same in case of Language and Mathematics also. But when key variables were allowed, the 
ults appear differently in case of Language. 


3.8.11 Homework checked at school 


: Table 8.12: Regression results — Students getting homework checked at school | 


ETT AE SA — TNA 
Without key variables | Tr | 189 | * | m86 | 193 | * | m30 | 198 | ** | 
[With key variables [150] 180 | ** omm 189 | * [ moe | 196 | ** j| 


Significant if P<.05, **Significant if P<.01, NS-Not Significant 


Variables 


Pupils who have their homework checked at school by the teacher do substantially better than those who don't. This 
was proved by the results in all the three subjects. It was also true when key variables were allowed. 


8.8.12 Learning-related home activities 


In addition to formal homework or tutoring, students’ out-of-school activities may influence their learning 
development in other ways, either positive or negative. Some activities may be directly related to subject taught in 


school, others less so. 


Table 8.13: Regression results - Students who read material other than course material outside the school 


Without key 
variables 
Books that explain things 
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*Significant if P«.05, **Significant if P«.01, NS-Not Significant 
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All activities indicated above are related with better performance in different school subjects, even the less likely 
activities such as reading comic books or reading directions or instructions—and the more frequently, the higher the 
performance. Allowing for the key variables reduces the relationship but it is still significant. While it seems likely 
that such activities would relate, at least to some extent, to reading performance, some other activities are clearly not 


directly related and might be thought to subtract from learning opportunities. 


8.8.13 Other home activities 


Students were asked whether they indulged in non-reading activities at home. 


Table 8.14: Regression results — Students doing various activities outside the school 


variables 
0.47 
05 eee o» s 


about school 
about school 
variables 
[Friends [131] 
[sports| 036 | 
Tell friends 
about school 
Tell family 3.70 


about school 


Without key 


EE 
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. 
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"Significant if P<.05, **Significant if P«.01, NS-Not Significant 


Watching TV, hanging out with friends, using internet, and telling friends and family about the studies in school 
all appear to be related to higher attainment, though on the whole, less so after allowing for the key variables in 
Language. However, in Mathematics and EVS, hanging out with friends, participation in sports, using internet, and 


telling friends and family about the studies in school have also shown positive effect on achievement of students. 
8.8.14 Household tasks 


While it seems obvious that reading-related activities are likely to be related to performance, other activities could 


possibly have a negative impact. Thus, if a student has to spend too much time doing household or family chores, 
then he or she would have less time for school work. 


116 


Student-related Variables 


Table 8.15: Regression results - Students doing household tasks 


| Without key 
variables 


Looking family 
member 
Looking family 
member 


icant if P<.05, **Significant if P<.01, NS-Not Significant 


aps surprisingly, there is no evidence that the load of domestic tasks is negatively related to attainment, at least at 
level encountered here, There is even some evidence that time spent caring for the family and cleaning the home 
ssociated with slightly higher attainment. However, in Mathematics, preparing food hampered achievement of 


lents. 


) Conclusion 


tudents from affluent families and having more educational resources have better chance to outperform at school 
han their counterparts. Some interesting findings were observed with regard to the educational resources available in 

100ls. It was observed that more number of students were taking private tuitions and getting help in studies from 
icir family members. On a positive note it was found that overall, 90% of students liked their school and tried to 


their best. 


vor analysis, parental education, parental occupation, number of books at home, and possessions at home were 


combined to form an index of socio-economic status. 


[he relation between attainment in different subjects and a wide range of factors connected with students home and 
background was analysed. It is well known that one cannot make definite causal inferences from a cross-sectional 
study as one cannot be sure of the direction of causation, nor that both the outcome and the potential cause are not 
caused by a third variable. Also, much of the information relates to relatively recent time rather than the students’ 
whole experience. However, we carry out comparisons between a factor (such as mode of transport) first on its 
own and then simultaneously allowing for the key variables, socio-economic status and language spoken at home. 
If making this allowance gives rise to a substantial difference to the factors relationship with the outcome, then it 
is likely that both are a product of socio-economic factors. For example, students from better off families are likely 
to do better at school and not walk to school. Conversely, if a relation between a factor and an outcome is not 


extinguished by making such allowances, it is reasonable to suggest that the factor is having an effect on the outcome. 


Factors investigated included gender, caste category, number of siblings, being physically challenged, mode 
of transport to school, and having a subject textbook. All these are related to attainment as might be predicted. 
Generally the relationship is weakened by allowing for the key variables, but not extinguished, suggesting that the 


key variables do not entirely explain the connection. 
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In addition to resources and other home factors, students’ attitude to subject is likely to be related to performance. 
Students who had a positive attitude to learning in different subjects did better than their counterparts. Homework is 
generally accepted in the profession to improve performance, though evidence from international studies is not clear 
cut. It is likely that successful students may well do homework, but it is also likely that struggling students may be 
given extra homework to help them to catch up. Students who get help at home and whose homework is checked at 
home do better, as do the vast majority whose homework is checked in class by the teacher. Interestingly, the relation 
with help at home is reduced if not removed after allowing for the key background factors, while that with setting 
homework and checking it at school is effectively unchanged. Is it only the resources in general that contribute to 
the effect of homework, or is it only better off families in general who do this? Students who have private tutoring do 
not do any better, and indeed do worse after allowing for the key variables, suggesting that tutoring is mainly used 
as a way of helping struggling students than as a means of getting ahead. 


Some behaviours could be expected to be associated with better attainment at school, especially if on the face of it 
they are related to school subjects. Thus, students who read out of school perform better. This difference seems to be 
observed for any type of reading. It is largest for reading newspapers, but is still significant even where the reading 
consists of material not strongly associated with learning, such as reading comics or instructions. These relationships 
are reduced but not removed after allowing for the key variables. Other activities less directly related to school subject 
show a more mixed picture. Watch television or videos, hanging out with friends, using the internet, discussing with 
your friends about what you learn in school and telling your family about learning in school are all associated with 
better performance, both with and without allowing for key variables. Working with computer and playing sports 
or games are not significantly associated with better performance, and indeed the former is associated with poorer 
performance after allowing for the key variables. One might expect that having to perform domestic chores would 
be associated with poorer performance if it took time away from school work. However, this does not seem to be the 
case: there is even a small positive association with some aspects of household duties. 


The following factors appear to have a robust effect on attainment in different subjects, in the sense that the 
relationship is statistically significant and is not extinguished by allowing for other important variables including 
home resources and speaking the language of instruction at home: 


= Number of siblings (negative) 
= Being physically challenged (negative) 
m Mode of transport 
m Having a subject textbook 
W Positive attitude to learning 
m Help in studies 
m Homework checked at school and at home 
m Reading out of school 
m Watching TV 
m Hanging out with friends 
m Discussing school at home 
m = Working with the computer (negative) 


W Using the internet 
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CHAPTER 9 SCHOOL-RELATED VARIABLES 


Part I-Profile 


[he success of schools in delivering quality teaching is clearly something that both federal and provincial governments 
need to monitor if they are to identify the characteristics of a healthy learning environment which maximises student 
achievement. This chapter reports the findings of the NAS in terms of the school variables. A questionnaire was used 


to collect information on 25 variables from school principals. These variables were grouped into four categories: 


= School Background: This category consists of variables that are indicative of school management, location, basic 


infrastructure and facilities, and classes for which school is providing education. 


m  Home-School Interaction: Included here are those variables that may be influenced by both home and school 


factors. These included attitudes of students, teachers and parents to the school. 


= Teaching and Learning Process: This includes variables that describe aspects of classroom instruction, such as 


availability of computers and internet facilities, methods of teacher evaluation etc. 


= School Social Climate: The school social climate consists of factors that are conducive to a safe, organised and 
productive learning environment. Included are school discipline problems, such as absenteeism and more serious 


misbehaviour. 


9.1 School Background 


The school background variables were: 
m School management 

= Location 

= Resources available in the school 


W  Inadequacies in the school affecting educational interaction 


9.1.1 School management 


Of the schools surveyed, approximately 70% were managed by the state government and the schools managed by the 
Tribal Social Department constituted only 1% of the sample. The rest of the schools were almost equally distributed 


amongst zila parishad, local body and private aided. 


Figure 9.1: School by management type 


1% 


E State govt/Dept m Zila parishad m Local body 
m Tribal social Dept m Private aided 
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9.1.2 School location 


Of the schools surveyed, one-fifth were urban and the rest rural. 


Figure 9.2: Location of school | 


B Rural 
Bi Urban 


9.1.3 Facilities available in the school 


The data regarding the availability of the following facilities in the school was collected. These were categorised into 
three groups: 


m Physical facilities: Electricity connection, safe drinking water, water pitchers, mats and furniture, dustbins 


playground facilities, toilets, separate toilets for girls, pucca buildings. 


m Teaching and learning materials: Mini toolkit, mathematics and science kit, globe, books for library/referenc: 


books/encyclopedia/children’s books, newspaper/ magazines/journals, blackboard, television, computers. 


= Ancillary facilities: Games equipment, play material, musical instruments, first-aid, annual medical inspection, 
immunisations. 


Figure 9.3 shows that the basic physical facilities are available in a substantial majority of the schools sampled 


Approximately two-thirds of the schools have playground facilities, three quarters have separate toilets for girls and 
85% have safe drinking water. 


Figure 9.3: Physical facilities | 
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Figure 9.4 shows the availability of teaching and learning materials in the schools sampled. Mathematics kit, globe, 
books for library, and children's books are available in more than 70% of the schools sampled. Although under 
the SSA programme, state governments have put in place reforms to improve the delivery of computer systems in 
schools, computers are still available in fewer than half of the schools sampled. 


Figure 9.4: Teaching and learning materials 


Computer P - 45 

Television 35 
Blackboard 96 
Magazines ag 50 


Children's book 86 


Encyclopedia 39 
Reference book 81 
Globe 92 
Science kit 


Maths kit 74 


Mini tool kit 56 


Under SSA, health registers are to be maintained in all the schools. The nodal officer is identified and nominated by 
the Department of School Education for each school for health checkups. Of the ancillary facilities available, in over 
70% of the schools, a medical checkup is carried out. Games equipment is available in 75% of the schools sampled 
whereas musical instruments are available in only 41% of the schools (Figure 9.5). 


Figure 9.5: Analysis facilities 


Musical Instrument 41 
Medical check-up 73 
immunization facility 68 
First aid 53 
Games Equipment 75 
77 


Play material 
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9.1.4 Shortages and inadequacies in school affecting educational interaction 


The extent to which schools felt that shortages or inadequacies in schools affected their ability to provide instruction 


was stratified into four grades: none, a little, some, and a lot. The necessities were as follows: 
m = Instructional materials 

= Budgets for supplies 

m School buildings and grounds 

m Heating/Cooling and lighting system 

m Instructional space 


m Special equipment for handicapped pupils 


Of the schools sampled, fewer than 20% felt that shortages or inadequacies in instructional materials, budget for 
suppliers, school buildings and grounds, heating/cooling and lighting systems, instructional space, and special 
equipment for challenged students did have a lot of effect on the school’s capacity to provide instruction. Also, over 
one-third of the schools sampled did not feel that the shortage of the above had any effect on the school’s capacity 
to provide instruction and 62% of the schools sampled did not feel that their capacity to provide instruction was 
affected by shortage of special equipment for challenged students (Figure 9.6). 


Figure 9.6: Shortages and inadequacies affecting teaching capacity à 


"None Alle =Some mAlot 


School building 
Heating-Cooling 


Instructional material 
Budget supplies 
Instructional Space 


Equpment for-handicapped 


9.2 Home-School Interaction 


The involvement of parents in various activities of the schools like attending special events, 
that the child completes homework, membership of school committees etc. contributes 
atmosphere as well as to effective home-school interaction. The home-school interaction cat 
variables which are jointly influenced by both home and school factors, Th 
of students, teachers and parents towards the school and the process of edu 


raising funds, ensuring 
to a healthy learning 
egory represents those 
€ aspects surveyed in this were attitudes 
cational transaction. 


9.2.1 Factors related to attitudes of students, teachers and parents towards the school 


The attitudes of the primary stakeholders, i.e., students, teachers and parents, 


to education in general and their 
child's school in particular, are extremely important factors affecting the teachin 


g and learning process. This study 
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has collected information on the following factors: teachers’ job satisfaction, teachers’ understanding of curricular 
goals, teachers’ degree of success in implementing the curriculum, teachers’ expectations of students’ achievement, 
parental support for students’ achievement, parental involvement in school activities, students’ regard for school 
property, and students’ desire to do well in school. All the above factors were collected in five levels—very high, 
high, medium, low and very low. Overall, the majority of responses are in the high and medium zones. More than 
50% of the schools reported teachers’ job satisfaction, teachers’ understanding of the curricular goals, teachers’ 
degree of success in implementing the curricula and teachers’ expectation of student achievement as high (Figure 
).7). Approximately 40% of the schools reported parental support for students’ achievement, parental involvement 
y school activities, and students’ regard for school property as medium. Over 60% of the schools rated students’ 
esire to do well in school as high. 


| Figure 9.7: Attitudes to school 


wVeryhigh "High = Medium «Low 


TUN 


9.3 Teaching and Learning Process 


Teacher job satisfaction 
teachers expectation for student 
Parental support for student 
Parental involve in school 
Regard school property 

Student ambition 


Teacher understandant cubic goals 
Teachers success implementation 


Teaching and learning is a process that includes many variables. These variables interact as learners work towards 


their goals and incorporate new knowledge, behaviours and skills that add to their learning experiences. The present 


survey included the following variables: 
B Availability of instructional materials 
B Availability of computers and internet facilities 


B Availability of assistants to teachers in using information and communication technology (ICT) 


W Methods of teacher evaluation 


9.3.1 Instructional materials 


The availability of instructional materials in the form of textbooks, workbooks, teacher handbooks, and Teaching 
Learning Material (TLM) contributes to effective classroom interaction and provides invaluable help in ensuring 
quality and uniformity in teaching and learning process. It was found that 9096 of the schools had textbooks in EVS, 
Mathematics and Language, 5796 had workbooks in all the three subjects, a teachers’ handbook was available in 70% 
of the schools and TLM was available in more than 8096 of the schools sampled. 
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Figure 9.8: Availability of instructional materials 


Textbook Workbook Handbook TLM 


9.3.2 Availability of computers, internet facilities and assistance to teachers in using ICT 


The survey asked for the number of computers in the school for educational purposes, access to internet facilities fo: 
educational purposes and availability of help to teachers to use ICT for teaching and learning. The average number 
of computers per school was 1.59 in the participated schools; 85% of the schools sampled did not have access to the 
internet (Figure 9.9); and around 72% of the schools did not have ICT facilities (Figure 9.10). 


Figure 9.9: Internet access | Figure 9.10: ICT facilities T 


Most Some 
(more then half) (below half) M Yes WB No 


9.3.3 Methods of teacher evaluation 


The study carried out teacher evaluation in the schools by the following methods: 
W Observations by the principal 

W Observations by inspectors 

W Students achievements 


a Teacher peer review 


Each of these types of evaluation is used in most schools. As shown in Figure 9.11, the schools reported that 92% 
used observations by the principal, 77% observations by inspectors, 94% students’ achievement and 82% teacher 


peer review. 
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Figure 9.11: Methods of teacher evaluation 
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9.4 School Social Climate 


The school climate is concerned with the psychological context in which school behaviour is rooted. School climate 


is considered to be a relatively enduring quality of the school that is experienced by the teachers and students and 


which in turn influences their behaviour. The school social climate category here consisted of problem behaviours 


amongst students. 


9.4.1 Problem behaviours amongst students 


Behavioural problem areas of the students were graded into five frequencies of occurrences of such behaviour— 


never, rarely, monthly, weekly and daily. The major areas probed were: 


Late arrival to school 

Absenteeism 

Skipping classes 

Non-adherence to the school dress code 
Disturbing the classroom decorum 
Indulgence in cheating 

Using profanity 

Indulgence in vandalism 

Activities of theft 

Intimidation/Verbal abuse to other students 
Causing physical injuries to others students 
Intimidation/Verbal abuse to teachers 


Causing physical injuries to teachers 


Fortunately, such aberrant behaviour was rarely seen in most of the schools sampled 
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(Table 9.1). Nearly 90% of the schools never or rarely saw late arrival to school. Absenteeism was rare in 59% of 
the schools. In 53% of the schools, skipping classes by students was never observed. Non-adherence to the school 
dress code was never observed in 45% schools. Disturbing the classroom decorum was never observed in 53% of 
the schools. 64% of the schools never observed student indulgence in cheating. 68% of the schools never observed 
students using profanity. Indulgence in vandalism was never observed in 71% of the schools. Activities of theft were 
never observed in 77% of the schools. Intimidation/Verbal abuse to other students was never observed in 54% of 
the schools. Causing physical injuries to other students was never observed in 60% of the schools. Intimidation/ 
Verbal abuse to teachers was never observed in 88% of the schools, and causing physical injuries to teachers was 


never observed in 94% of the schools. 


| Table 9.1: Problem behaviours amongst students 


Part II-School Factors and Student Attainment 


In the previous chapter, we looked at the relation between home background and attainment in different subjects, 
and found it substantial in many ways. However, no matter how strong the relation is, the relation with school 


characteristics has to be central since with all due acknowledgment of home tutoring and homework, essentially, 
school is where academic learning takes place. 


Because this is a cross-sectional study, it is of course not possible unambiguously to assign causality to possible 
contributory factors. In particular, many of the possible factors are likely to be related to social resources available 
to the students. To attempt to take some account of this, in chapter 8 we considered the relation between outcomes 
and factors investigated, first on their own and then allowing for socio-economic background and language spoken: 
these are described as key variables. In this chapter, we follow the same approach, first consider the relationship on 
its own, and then after allowing for key variables. If a relation between a factor and an outcome is not extinguished 
by making such allowances, it is reasonable to suggest that the factor is having an effect on the outcome. 


9.5 Treatment given to Variables used in Analysis 


School-related variables were treated in the following manner: 
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Table 9.2: School-related variables and ¡ts treatment for regression analysis | 
Categories of Variables | Treatment | 


a) State Government/Department of Education, b) Zila Parishad, c) “STATE GOVERNMENT/DEPARTMENT 
Local body, d) Tribal social department, e) Private aided OF EDUCATION’ as a base category 


a) Yes, b) No ‘NO’ as a base category 


a) Economically disadvantaged homes, b) Middle income homes, c) — | Three dichotomous variables 
Economically affluent homes were created to indicate schools 
with more than 50 per cent of 
pupils from each of the three 
categories. 
A scale was created by summing 
the number of ‘YES’ responses 


| School management 


| Attachment of pre 
| school 
Students’ background 


infrastructural 
facilities 


a) Games equipment, b) Play material and toys, c) Mini toolkit, d) 
Mathematics kit, e) Science kit, f) Globe, g) Books for library, h) 
Musical instruments, i) Notice board, j) Blackboard, k) Television, 1) 
Computer, m) Electric connection, n) First aid, o) Medical checkup, p) 
Immunisation facility, q) Safe drinking water, r) Water pitcher, s) Mats 
and furniture, t) Dustbin, u) Playground facilities, v) Toilet facilities, w) 
Separate toilets for girls, x) Pucca building 


instructional a) Textbooks, b) Workbooks, c) Teacher Handbooks, d) Teaching and | A scale was created by summing 
materials learning material the number of 'YES' responses 


5chool perception a) Teacher's job satisfaction, b) Teacher's understanding, c) Teacher's — | Responses were coded from very 
degree, d) Teacher's expectation, e) Parental support, f) Parental high to very low 
involvement, g) Students’ regard for school property, f) Students’ 


desire to do well in school 


a) Observations by the principal, b) Observations by the inspectors, c) 
Students' achievement, d) Teacher peer review 
a) Arriving late at school, b) Absenteeism, c) Skipping class, d) Treated as quasi-continuous 
Violating dress code, e) Classroom disturbance, f) Cheating, g) variables 
Profanity, h) Vandalism, i) Theft, j) Verbal abuse of other students, 
k) Physical injury to other students, I) Verbal abuse of teachers, m) 
Physical injury to teachers 
a) Instructional materials, b) Budget for supplies, c) School building 
and grounds d) Heating/Cooling and lighting, e) Instructional space, 
f) Equipment for handicapped students, g) Computers for Math 
instruction, h) Computer software for Mathematics, i) Library materials, 
j) Audio-visual resources, k) Science laboratory, I) Computer for EVS, 
m) Computer software for EVS, n) Library materials to EVS instruments, 
0) Audio-visual resources, p) Teachers, q) Computer support staff 


Student computer Ratio of number of pupils to number of computers was calculated re c 
ratio 


a) All, b) Most, c) Most, d) None 'NONE' as a base category 
|UeofiT  |a)Yes b) No ‘NO! as a base category 


As in the previous chapter in the regressions described here, one category, usually the largest, is designated as a ‘base’ 


| Evaluation of practice 
| of teachers 
| Behaviour problems 


A scale was created of the 
number of resource problems. 


Inadequacy of 
facilities 


category and assigned a zero value, and all other categories were defined in terms of their difference from the base 


result. 


Since students were the basis for sampling, the student remains the unit of analysis, regardless of the source of 


information from the questionnaires. That is, the results shown in the tables in this chapter are the percentages of 
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students whose school principals reported on a particular activity or characteristic and who completed a test on 
the relevant subject, in this case Language. Typically, because of the matrix sampling scheme which means that no 
students were tested in all the subjects, this is of the order of two-thirds of the number with questionnaire responses 
When a teacher or principal did not complete the assigned questionnaire, background data was not available fo: 


those students. 


9.6 School Facilities and Resources 


Under this, the information regarding games equipment, play material and toys, mini toolkit, globe etc. were collect: 
from school. These facilities were treated as infrastructural facilities available in the school. Further, information w 
gathered regarding inadequacy or shortage of facilities such as instructional materials, school buildings and ground 
heating/cooling and lighting systems, instructional space (e.g., classrooms), special equipment for handicapp 
students etc. Besides, information about availability of computer, access to internet and assistance to use ICT 
teachers for teaching and learning process was also sought. 


Possessing a resource does not mean that it is used wisely, or even at all, and it could be that some resources are le 

relevant in this day and age with the wide availability of information from the internet. Another way of looking a 
the same question is to ask whether school’s capacity to provide instruction is affected by a shortage or inadequa: 

of resources. The answer to this could be none, a little, some or a lot. 


9.6.1 Infrastructural facilities 


we T s 


^c -N 
[wih ey vrabies | 7056 | on | D 


*significant if P«.05, **Significant if P«.01, NS-Not Significant 


Table 9.3: Regression results = Schools facilities 


Pupils in schools with more infrastructural facilities performed significantly better as compared to the pupils in 
schools with fewer facilities in all the three subjects. 


9.6.2 ICT facility 


Of particular contemporary interest is access to computer facilities. Schools were asked about internet a 


ccess, the 
number of students per computer and whether the school had communication technology help 


9.6.2.1 Student-Computer ratio 


Table 9.4 : Regression results - Student-Computer ratio 


Without key variables | 095 | 
With key variables | 090 | 


"Significant if P«.05, **Significant if P<.01, NS-Not Significant 
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Pupils in schools with a higher ratio of computers performed better than the pupils in schools with a lower ratio of 
computers in Language, Mathematics and EVS. 


9.6.2.2 Access to internet 


Table 9.5: Regression results — Access to internet 


[se [5 | Ger | [toot [ s 
Fwithoutkeyvariabes | -9& | -55 | 


With key variables 
“Significant if P<.05 , **Significant if P«.01, NS-Not Significant 


Access to internet has shown negative effect on achievement of students in different subjects. 


9.6.2.3 Use of ICT 


Table 9.6: Regression results - Use of ICT 


Without key variables 
With key variables 


*Significant if P<.05, **Significant if P«.01, NS-Not Significant 


Availability of help to the teachers to use ICT for teaching and learning had positive impact on achievement in 


Language and EVS. 


As far as students in schools with internet access are concerned, the majority did worse than those without. However, 


students in schools with communication technology help performed better than students in schools without. 


9.7 School Governance 


Another important aspect of a school's function is its context, including its governance and composition. 


9.7.1 School management-wise 


Table 9.7: Regression results - School management 


Variables 


Without key 


variables mm — o 
on | ws [as] v» [Ws 
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With key | Zila Parishad 
variables | Local Body/Mun. Com. 


*Significant if P«.05, **Significant if P«.01, NS-Not Significant 


Nearly two-thirds of the sample attended schools managed by the state government/department of education, 1° 
in tribal and approximately 10% in each of the other categories. Students in private aided schools, zila parishad and 
local body/municipal committee/urban local body perform better, and while this is slightly reduced in local boc 
schools by allowing for key variables, the difference is still substantial. By contrast, though the pupils in the trib: 


schools showed a poor performance but the results were not significant statistically. 


9.7.2 Attachment of pre-school 


Table 9.8: Regression results — Pre-school attached 4 


| [ sg | mer | st | sig | 
EA EREA EA 
EA E 


[m | 1» | 


"Significant if P<.05 , **Significant if P«.01, NS-Not Significant 


Itis known that students with experience of pre-school are likely to perform better than those without any compara! 


experience. There is no information about the length of pre-school experience of the sample, but students wi 
attend a school with a pre-school attached do worse. 


9.8 Compositional and Contextual Factors 


Value-added investigations of school performance have shown that the main factor in determining the attainment o 
a school's graduates is the characteristics of the intake. 


Table 9.9 presents the characteristics of the sample, 


and shows the relation between average characteristics of th« 
pupils and performance in different subjects. 


9.8.1 Students' background 


vai language E SE) 
e E iu MH 


Without | Economically -4.02 1.32 
key disadvantaged 


eon a ajos 
wie w| e EECNE ENTM 


Economically 1.47 3.82 
affluent 


“Significant if P<.05, **Significant if P<.01, NS-Not Significant 


132 


School-related Variables 


Difference in the achievement of pupils in schools with more than 50% from disadvantaged backgrounds, pupils 
in schools with more than 50% from middle income backgrounds and pupils in schools with more than 50% from 
affluent backgrounds was not statistically significant in Mathematics. In Language, pupils in schools with more than 
50% from middle income group have shown significantly better performance while pupils in schools with more than 
50% from economically disadvantaged group have shown poor performance. However, in EVS, pupils in schools 
with more than 50% from middle income group were found to have significant positive effect on their achievement. 


9.8.2 Instructional materials 


| Table 9.10: Regression results - Instructional materials | 


e Mathematics, — [| — — 805 — | 

| Gef | se | sig | mer | se [| sig | cef | st | sig | 
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significant if P«.05, **Significant if P«.01, NS-Not Significant 


Variables 


| Without key variables 
With key variables 


wailability of instructional materials like textbooks, workbooks, teacher's handbooks and TLM has not shown any 
positive effect on achievement of students. 


3.8.3 School perception 


Table 9.11: Regression results — School perception 
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variables [teachers understanding KENKEN 4.88 p E o | N | 


Teachers degree ofscess | ost | oe | 
Teachers’ expectations EUM | ou | 0.82 | 
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Students' regard for school 
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Students' desire to do well 


*Significant if P<.05, **Significant if P«.01, NS-Not Significant 
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A range of school-related variables as assessed by the principals were considered. Parental support, parental 


involvement and students’ regard for school property were found to be positively associated with pupil attainment 
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in all the subjects. Further, teachers’ degree of success in implementing curriculum and teachers’ expectations for 


student achievement have significant positive effect on Mathematics and EVS achievement. Besides this, teachers 


job satisfaction and students desire to do well were found to have positive influence on Mathematics achievement 
scores. 


9.8.4 Behaviour problems 


Table 9.12: Regression results - Behaviour problem of students —— 


[Without key variables | -037 | oo | ** | -w | s | * | = | m | 
they wis MAA on Joe] > pe [1 


*Significant if P<.05, **Significant if P<.01, NS-Not Significant 


Pupils in schools where the pupils as a whole exhibit more anti-social behaviour performed relatively poorly in al 
three subjects. 


9.9 Accountability-related procedures 


It is widely considered that some form of assessment or accountability is an important aspect of educational progres 
Thus, for example, while considering giving homework in chapter 8, it was observed that it was not sufficient ju 
to give homework: the pupils who performed well attended schools where the homework was marked in school. W 
next consider the information the study provides on assessment and accountability. 


Teachers too can be assessed. Table 9.13 shows four possible methods of assessing a teacher’s competence. 


9.9.1 Evaluation of practice of teachers 


Table 9.13: Regression results - Evaluation of classroom teaching j 1 


Without key 
variables 


With key 
variables 


"Significant if P<.05, **Significant if P<.01, NS-Not Significant 


According to principals, all four methods are used by 8096 of schools. Interestingly, 
inspectors were associated with higher attainment. 


peer review and observation by 
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9.10 Conclusion 


Students from better equipped schools have performed better than the students studying in less equipped schools. 
With regard to availability of physical facilities in schools, a large variation was seen. For example, whereas the 
blackboard, globe, children’s books etc. were available in more than 85% of schools, computer, television, mini 
toolkit etc. were available in less than 45% schools. While pucca building, safe drinking water and toilet facilities 
were available in more than 85% schools, necessary facilities like playground and electric connection were available 
only in 67% schools. On a positive note, over 90% schools reported that they asked the parents to get involved in 
their child’s learning process and over 60% schools reported that their students desired to do well in studies, 


This chapter has also considered the relationship between student attainment and school factors as gathered by a 
questionnaire from head teachers/school principals. It goes without saying that it is the place where the majority 
of transmission of academic knowledge takes place. Nevertheless, home influences are paramount in the progress 
of learning: some students learn more quickly than others, and very often this can be linked to home background. 
To take some account of this, the relation between school factors and student attainment is presented in two ways, 
first on its own, and then after allowing for key home factors, socio-economic status, and speaking the language of 
instruction at home. 


Schools were asked whether they possessed a wide range of resources for education. It was found that students in 
schools which possessed nearly all the possible resources performed well. Allowing for home key variables did not 
remove the better performance of the best-equipped schools. There is little point in having resources if they are not 
used; perhaps a more important indicator is whether a school feels that a lack of resources is inhibiting it. Nearly half 
of the students were in schools where principals had quite a high perception of being inhibited in this way, yet there 


was no significant difference in performance of their students. 


Computing resources are an increasingly important aspect of school facilities, but findings are somewhat mixed. 
Pupils in schools with higher ratio of computers performed better than those with low ratio of computers. Pupils in 
schools with internet access do worse than those without. Students in schools with communication technology help 


perform better than schools without communication technology. 


Another important aspect of a school’s function is its context, including its governance and composition. Principals 
were asked which of these bodies managed their school. State schools (the majority) did worse than schools under 
different types of management, except those which were under the tribal social department. Pupils in schools where 
50% of pupils are from middle income families do better, while pupils in schools where 50% of pupils are from 


disadvantaged families do worse. 


School ethos and atmosphere is generally considered to be essential in promoting pupils attainment. Pupils in 
schools in which parents are asked to take part in a range of activities do better than those in less inclusive schools. 
This difference largely disappears after allowing for student key variables. Pupils in schools where the principal 
considers that parents have a high degree of involvement in school activities do better, but parental support for pupil 
attainment is not significantly related. Parental involvement and inputs are generally only indirect factors - though 
obviously very important ones - in the more important ones of pupils attitude towards school. Pupils in schools 
where the principal considers that they have a high desire to do well are likely to attain (slightly) better, and this 
difference is little affected by allowing for background key variables. Having a high regard for school property is 


significantly related to attainment. 
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Principals were asked about problem behaviour in the school. It was found that the majority did not have frequent 


problem behaviour in their school, but where there was any frequent problem behaviour, pupil atrainment was lower. 


It is arguable that some form of assessment or accountability is an important aspect of educational progress. It is 
not just students who can be assessed: principals were asked whether teachers were assessed by observations by the 
principal or senior staff; observations by inspectors or other persons external to the school; student achievement; o: 


teacher peer review. Only teacher peer review and observation by inspectors were associated with better performance 
by pupils to any great extent. 


The following factors appear to have a robust effect on attainment in different subjects, in the sense that the 
relationship is statistically significant and are not extinguished by allowing for other important variables including 
home resources and speaking the language of instruction at home: 


m Equipment 

W School governance 

m Pre-school attached (negative) 

= Student-Computer ratio 

m Internet access (negative) 

m Help in communication technology 
m= Middle income 

Disadvantaged pupils (negative) 


School involves parents 


Pupils desire to do well 
= Problem behaviour (negative) 


m Teacher peer review. 


It is interesting to note that the differences relating to school factors are considerabl 


y smaller than those relating to 
student factors. 
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. Teacher-related Variables 


CHAPTER 10 TEACHER-RELATED VARIABLES 


Part I-Profile 


‘Teachers are a vital component of the educational process and it is therefore important to know the characteristics of 

teachers, the strategies they use in the classroom, and their general attitudes towards teaching in schools. This chapter 

provides information about some of the important characteristics of the class V teachers in the survey, categorised 

into four headings: teacher background, teacher training, teaching learning process, and teachers’ opinion about 

their school. The teachers who taught the sampled students in the subjects tested were asked to complete a Teachers’ 
Juestionnaire. A total of 10,851 teachers responded as shown in Table 10.1. 


| Table 10.1: Teachers included in survey ' 


Number responding 
m — | 3 | 
Rajasthan 
33. Tamil Nadu 
4 


ham [| 
Hmm — mme | mw ] 
mmm | m | 


Meghalaya 


295 
416 
261 
290 
263 
324 
392 
326 

63 
561 
257 
T3 
T1 
102 


10.1 Teachers” Background 


The questionnaire collected information on a wide range of background factors as set out in the paragraphs that 


follow. This chapter summarises findings for all teachers in the sample. 


10.1.1 Gender 


Of the teachers from class V who took part in this survey, half were female and half male. 
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| Figure 10.1: Male and Female Teachers 


E Male @ Female 


10.1.2 Age 


The age profile of the teachers completing the survey questionnaire is given in Figure 10.2. In our sample, 23% 


teachers were below the age of 30, whilst about 13% were above 50 years of age. 


Figure 10.2: Age of teachers 


W Below 30 Year W 51-40 Years W 41-50 Years W 51-65 Years 


10.1.3 Educational qualification 


The survey asked primary school teachers about their highest educational qualification. The results showed tha: 


overall, 64% of the teachers in the sample were graduates or post graduates, 24% were qualified at higher secondary 


level, and 1096 of teachers were qualified at secondary level. 


Figure 10.3: Educational qualifications of teachers 


Middle 
(296) 


Secondary ae 


Post 
Graduation 


Graduation 
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10.1.4 Teachers' employment status 


In India, states differ from one another on policies and requirements for appointing teachers. Under SSA and the 
Right to Education Act (2009), enrolment in schools up to upper primary classes has substantially increased. The 
Government of India and state governments are making efforts to provide basic infrastructure to all schools to meet 
the immediate demand. Many states have appointed para teachers, shiksha karmi and part-time teachers to meet this 


lemand. The employment status of teachers is presented in Figure 10.4. 


Figure 10.4: Employment states of teachers 


Temporary Para teacher 
(696) (1196) 


Against leave 
(196) 


Other 
(396) 


ure 10.4 shows that the majority of teachers, (nearly four-fifths), were regular or full time teachers, whereas 
und 196 were working against leave vacancies and 1196 were para teachers. The para teachers were appointed by 
1e states to meet the immediate demand of teachers in schools. 


.2 Teacher Training 


ensure high quality education in schools, it is necessary that teachers should be trained. There are two types of 
cher training programmes, namely pre-service training and in-service training, prevalent in our education system. 
: basic pre-service qualification necessary to be appointed as a teacher in a school is a certificate level/diploma 
degree programme, e.g. JBT, B.Ed., M.Ed. etc. In-service training is provided for further development of those 


chers who are teaching in schools. 


10.2.1 Professional qualification 


In India, a professional qualification is essential for getting a regular/permanent job in government and government 
aided schools. A professional qualification helps teachers to understand various methods of teaching, school 


environment and psychological aspects of the students’ personality. The distribution of the professional qualifications 


of teachers is presented in Figure 10.5. 


Figure 10.5: Professional qualification of teachers 


MEd and 
Graduate others 
Training (2%) 
Primary or 
elementary 
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Survey data shows that 64% of teachers were primary/elementary teaching certificate or diploma holders. The 


percentages of graduate and post-graduate degree in professional courses were 34% and 2% respectively. 
10.2.2 In-service training programme 


In the states, various agencies such as SCERT, DIET, BRC, CRC etc. organise in-service training programmes for 
teachers to update them with the latest trends and build their capacity for their classroom teaching. Teachers wer 
asked how many such programmes they attended during the last two years. The information collected reflects th 


activeness of various academic agencies in organising in-service training programmes. 


Figure 10.6: In-service training programme attended by teachers 


None 


3 or more 


Two 


Number of training programmes attended: Figure 10.6 shows that nearly a quarter of teachers did not attend : 
training programmes, 1296 of teachers attended one, 2196 two and 4396 three or more training programmes. 


10.2.3 Attending training programmes based on NCF-2005 
NCERT gave academic help to states for providing training to teachers in the National Curriculum Framew: 
(NCE), 2005. NCERT also organised many training programmes at Delhi and also in states to train key resou 


persons. Figure 10.7 indicates that overall 37% of teachers attended a training programme based on NCF 2005. 


| Figure 10.7: Teachers attended training based on NCF-2005 


E No W Yes 


10.3 Teaching Learning Process 


With the introduction of NCF-2005, there was a paradigm shift in the teaching learning process. The new option 


was a constructive approach which believed that pupils construct their own knowledge and that the teacher was a 


142 


Teacher-related Variables 


facilitator who guided the pupils to think, to solve problems and to learn on their own. This demanded a change in 
role of teachers, learning environment, instructional strategy, methods of teaching, curriculum and assessment of 
students. Information on some of the above variables such as teaching style, academic facilities and modification of 


curriculum according to NCF-2005 etc. was sought in this questionnaire. 


10.3.1 Teaching style and academic facilities 


[o teach in the classroom and track the progress of students’ learning, teachers use various strategies. Giving 
omework is one of the techniques used and the assessment of homework helps teachers to know the students’ pace 
f learning. Teachers are also provided with a “Teacher's Diary’ to maintain a day-to-day record of activities planned 

| executed in the class. This helps teachers as well as supervisors to know what teachers did on a particular day 
: period in a class. It also helps teachers in planning for a lesson to be taught in the class as well as to note down 
cific queries made by the students on a particular topic. If required, the teacher’s diary may also be used as a tool 


assessment of teachers’ work in the school. 


teaching in the class, teachers use the teacher’s handbook, teaching learning material (TLM), and audio-visual 
lities. Under SSA, there is a provision of Rs. 500 per annum for a teacher for development of TLM. Readymade 


Ms are also available for the use of teachers on different topics in a subject. 


her under SSA, teacher resource centres (TRC), cluster resource centres (CRC) and block resource centres 
:C) have been developed in each district of the country. The role of these agencies is to provide academic support 


teachers to accelerate the teaching learning process. To understand the status of all these, the information was 


lected under the following heads: 
Homework 
Teacher’s diary 
Resources available 


Academic support 
> outcomes are presented below: 


0.3.2 Homework 


Figure 10.8 shows that fewer than 1% of teachers did not give homework at all, while 1496 of teachers gave homework 


sometimes, and 8596 of teachers gave homework regularly. 


Figure 10.8: Teachers give homework 


Not at all 


Sometime 
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10.3.3 Teacher's diary 


Figure 10.9 indicates that 87% of teachers reported maintaining a teachers diary. 


| Figure 10.9: Teachers diary ; 


m Yes W No 


10.3.4 Teaching aids and TLM grant 


Figure 10.10 shows the availability of teaching aids — teachers handbook (82%), TLM 94%, audio-video faciliti: 
(43%), and TLM grant (77%). 


Figure 10.10: Academic facilities available in schools 


94 
77 82 
i i | 
Hbk TLM AVS 


TLM Grant 


10.3.5 Interaction with other teachers 


Interaction among teachers helps to clear up doubts in organising content for development ofa lesson plan and using 
TLMs. It also helps teachers to improve teaching methodology and cover concepts in an improved way. Anecdotal 
evidence suggests that the practice is fairly unusual and that schools do not encourage such type of practices. To 


compare this perception with the situation on the ground, teachers were asked about their experience in this. 
Discussion about how to teach a particular concept: According to Figure 10.11, 56% of teachers reported that discussion 


among teachers about how to teach a particular concept took place “1 to 3 times per week”, 40% of reported “2 to 


3 times per month” and 4% of teachers said that such discussions almost never took place. 
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Almost never 


l 103 


2 to 3 times per times per week 


month 


ing on preparing instructional materials: Figure 10.12 shows that 41% of teachers reported interacting with 
gues to develop instructional materials 1-3 times in a week, 50% of teachers 3-5 times a week but 9% of 


ers almost never interacted in this way. 


_ Figure 10.12: Working preparing instructional materials | 


Almost never 


1to3 
2 to 3 times per times per week 


month 


it to another teachers classroom: Figure 10.13 indicates that 30% of the teachers almost never visited another 
icher's classroom to observe his/her teaching, and 29% and 41% of teachers reported that they visited another 


acher's classroom to observe his/her teaching 1-3 times per week and 2-3 times per week respectively. 


Almost never 


1to3 
times per week 


2 to 3 times per 
month 
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Informal observation of my classroom by another teacher: Figure 10.14 indicates that overall, 28% of teachers reported 
that their classroom teaching was almost never observed by another teacher, 47% of teachers were observed 2-3 
times per month by another teacher and 25% of teacher's classroom teaching was observed 1-3 times per week b; 
another teacher. 


| Figure 10.14: Informal observation of classroom by another teacher 


Almost never 1 103 


times per week 


2 to 3 times per 
month 


10.4 Problems in School 


Under the drive to Universalisation of Elementary Education, Central Government and State Governments ha 
made heroic efforts to bring all the children of 6-14 years in school. To give it legal back up, the Government 
India passed the Right to Education Act (2009). In addition under SSA since 2000, the Government of India ! 
provided large sums of money to the states for implementing the minimum required infrastructure for schools 


provide quality education to our children. In spite of the efforts made under SSA, there is need to work more in t! 
area. 


a) School building needs significant repair: Figure 10.15 shows that overall 16% of teachers felt that the need 
significant repair in the school building was a serious problem whereas 51% of teachers felt that it was a min 
problem. Overall, only one-third of school buildings do not need repairing. 


Figure 10.15: Visit to observe another Teacher's Classroom F] 


= Nota problem MMinerproblem # Serious problem 


Buildings Overcrowded Workspace 


Materials 


b) Classrooms are overcrowded: For a healthy atmosphere in the classroom, the teacher-pupil ratio should be 
appropriate and there should be proper space for sitting of the students. Figure 10.15 shows that overall, 17% 


of teachers considered it as a serious problem, 28% as a minor problem and for the rest it was not a problem. 
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c) Inadequate workspace outside the classroom: Teachers need some space outside the classroom for preparation of 
TLM and organising relevant activities. Teachers were asked to respond about the working space outside the 
classroom. The responses are presented in Figure 10.15. Around 13% of teachers reported that they did not have 
adequate workspace outside their classroom and that it was a serious problem, 33% of teachers considered it as 
a minor problem and remaining 55% of teachers considered it as not a problem at all. 


Materials are not available: Figure 10.15 indicates that 28% of teachers reported non-availability of material as 
a serious problem, 41% of teachers reported it as a minor problem and 31% did not consider this a problem. 


10.5 Teachers’ Opinion about the School 


important to know how well the teachers are aware about the curriculum goals, whether they are satisfied 
h their job, and what are their expectations from students and parents. Opinion about these factors directly or 
rectly indicates teacher's motivation and school environment where he/she is teaching. 


Figure 10.16: Informal Observation of Classroom by another Teacher | 


mVeryhigh mHigh wMedium WLow Very low 


Teacher job Teacher Teachers success Teachers Parental support Parental Regard school Student ambition 
satisfaction understandant implementation expectation for for student involvement property 
cubic goals student 


he responses on each sub-item were analysed separately and are presented below: 


Teachers job satisfaction: 60% of teachers reckoned that teachers in their school were highly satisfied with their 
job while only 9% reckoned that teachers had low job satisfaction. 

b) Understanding of curriculum goals: Understanding of curriculum goals is very important for planning of teaching 
learning strategies and classroom activities. If a teacher does not understand curriculum goals, then it will be 
difficult for him/her to translate it into the classroom. Figure 10.16 indicates that 64% of teachers thought that 
teachers in their schools had a high understanding of curriculum goals whereas only 8% reckoned that teachers 


had a low/very low understanding of curriculum goals. 

C) Success in implementing the curriculum: About half of the teachers feel that teachers degree of success in 
implementing curriculum is high or very high in their schools. 

d) Expectations for student achievement. 62% of teachers reported their expectations for their students were high, 
whereas only 9% of teachers reported low expectations for the students. 

e) Teachers view regarding parents support and involvement: One-fifth of the teachers were of the opinion that 
parental support was very high. 

fi Parents involvement in school activities: Overall, 17% of teachers reported parents’ involvement was high and very 


high whereas 44% of teachers reported it as low. 
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g) Student regard for school property: Around 41% of teachers answered that students in their schools had high or 
very high regard for school property but 17% of teachers reported that their students had low or very low regard 
for school property. 

b) Students desire to do well in school: 52% of teachers reported their students had the desire to do well in school 
and 11% of teachers thought that students did not have the desire to do well in the school. 


Teachers were asked about their perception of school safety, whether the school was located in a safe neighborhood, 
whether they felt safe at the school, and whether the school’s security policies were sufficient (Figure 10.17) 
substantial majority considered that the school and its environs were safe, but rather worryingly, approximately o 


fifth of those responding considered that at least one of these was unsafe. 


| Figure 10.17: Teachers' perception of school safety i 


Wi Feel safe W Not so safe 


Part II- Teacher Factors and Student Attainment 


In this survey, teachers were asked about their qualifications and experience, the subjects they taught, classre 
processes, and their views about the school. 


Teachers are generally accepted to be the most important system input into the learning process. However, it is e: 

to say this than actually to assess teacher effects, especially from a survey of this nature. First, the study deals with 
students who have been in school for at least five years. Encountering a range of teachers during that time and cr. 
sectional studies such as NAS will deal only with the last of these, Second, information in a teacher questionnair: 
especially relating to classroom practice, is typically self-reported: it is well known that teacher and student reports of 
the same classroom frequently do not agree. Also, it is difficult in this study to ensure that teachers’ data is related to 
the students they teach. Around 10% of the teachers did not indicate which subjects they taught. This is in addition 
to the usual caveats over direction of causation and the possibility that both learning attainment and its supposed 
cause are in fact the products of some more fundamental influence, such as home background and resources. To 
some extent we can investigate this last possibility by allowing simultaneously for the influence of the key variables, 
socio-economic status and home language. If a relation between a factor and an outcome is not extinguished by 
making such allowances, it is reasonable to suggest that the factor is having an effect on the outcome. Inference 


will however be less reliable based on the teacher questionnaire because of the factors noted earlier in this paragraph. 
^ 0, . 
Many teachers (over 40% of respondents) answered more than one section of the questionnaire and will have taught 


more than one of the three subjects, and over a quarter appear to have taught all three. All teachers who replied to 


the section in the questionnaire relating to Language teaching are included in the analyses 
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10.6 Treatment given to Variables used in Analysis 


The variables considered under the teacher background are as under: 


Table 10.2: Teacher-related variables and its treatment for regression variables 


Variables Ll Categories of Variables [Treatment 7] 
Gender 
category 
ge 


cademic qualification a) Middle or secondary, b) Higher/Sr secondary, c) 'Middle or secondary' as a base 

: Graduation, d) Post graduation 
ofessional qualification 
sining programmes 


'ining programme based | a) Yes, b) No 'NO' as a base category 
NCF-2005 


ofessional development | a) Yes, b) No ‘NO! as a base category 
ivities 
aching experience 
ars in school 
mployment status 
-gular homework 
escher's diary 
viods per week 
‘eraction with other a) Discussions about how to teach a particular concept, b) ‘NO! as a base category 
achers Working on preparing instructional materials, c) Visits to 
another teacher's classroom to observe his/her teaching, d) 
Informal observations of my classroom by other teachers 
a) Listen to a story and answer the questions put by you, 
b) Talk to each other on a given topic and come out with 
observations/conclusions, c) Work together in pairs or small 
groups and report the conclusions orally in the class, d) Read 
storybooks! newspapers /magazines on their own, e) Use 
dictionary to work out meaning of the unknown words used 
in the text, f) Write compositions on given topics, g) Relate 
what you read in the text with your real life experiences 


| Teaching resources a) Teacher's handbook, b) Teaching learning material, C) ‘NO' as a base category 
| Audio-video facilities 


| Problems with facilities a) The school building needs significant repair, b) Classrooms | 'NO' as a base category 
are overcrowded, c) Teachers do not have adequate 
workspace outside their classroom, d) Materials are not 
available to conduct experiments/investigations 
a) Yes, b) No 
Safety in School a) This school is located in a safe neighbourhood, b) I feel | ‘NO’ as a base category 
safe at this school, c) This school's security policies and 
practices are sufficient. 
Teachers' Attitude a) Teachers' job satisfaction, b) Teachers' understanding 'NO' as a base category 


'At least once a week' as a base 
category 


tivities in Language class 


of cuuriculum goals, 0) Teachers’ high degree of success in 
implementing the curriculum, d) Teachers" high expectations 
for student achievement 
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10.7 Personal Characteristics 


Personal characteristics of teachers such as gender, category and age were considered. 


With key variables goin 


Without key variables | Gils | E : | 


*Significant if P<.05, **Significant if P<.01, NS-Not Significant 


| Table 10.4: Regression results — Category-wise 


Without key variables 


With key variables 


*Significant if P<.05, **Significant if P<.01, NS-Not Significant 


Category and age of the teachers did not have a statistically significant relation with the attainment of the students. 


Female teachers were associated with slightly higher attainment, but this difference was not statistically significant 
after allowing for the key student variables of socio-economic status and students home language. 


10.8 Academic and Professional Qualifications 


Teachers’ education is an important aspect of their efficacy. They were asked about their academic and professional 
qualifications. 
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Without key variables 


= 
| With key variables 


nificant if P«.05, **Significant if P<.01, NS-Not Significant 


ichers' highest academic qualifications are not significantly related to attainment. 


Table 10.7: Regression results - Professional qualification | 


Variables 
hout key variables | 
h key variables 


ificant if P<.05, **Significant if P<.01, NS-Not Significant 


chers with graduate professional qualifications are more likely to be in schools with higher attaining students, but 
difference is relatively small and is not statistically significant after allowing for key student variables. 


9 In-service Training 


hing ability is not something that stands still as teachers are regularly offered the opportunity to attend in-service 
1ing courses. Teachers were asked about the number of in-service training programmes they had attended during 
zast two years and, more specifically, whether they had attended any training programme based on NCF-2005. 


Table 10.8: Regression results — In-service training programmes 


; Variables 
‘thout key variables | One- 


| With key variables 


“Significant if P<.05, **Significant if P«.01, NS-Not Significant 


Table 10.9: Regression results — Attended training programme based on NCF-2005 


Variables z 
Without key variables RA Eo 3 Duet 
With key variables PEA 


“Significant if P<.05, **Significant if P<.01, NS-Not Significant 


The majority had attended one or more in-service training course, including an NCF-based one. However, there is 


no statistically significant relationship with the attainment of students in these schools. 
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Table 10.10: Regression results - Participation in professional development activities : 


E AE 
cs  — 00 cO NUMEN NG 
DITTTNMN Serr nen Ex» 


*Significant if P«.05, **Significant if P«.01, NS-Not Significant 


Teachers were also asked whether they had participated in any professional development activities. The majority had 
participated in one or more of these but this showed no statistically significant relationship with the performance of 


the students in the school. 


10.10 Teaching Experience and Employment Status 


Of course teachers training and formal qualifications are not the only indicator of how capable they are. Experience 


is also a major contributor. 


Table 10.11: Regression results — Years of teaching experience 


Variables - 


Without key variables 
With key variables 


*Significant if P«.05, **Significant if P«.01, NS-Not Significant 


Variables 


Without key variables 
With key variables 


*Significant if P«.05, **Significant if P«.01, NS-Not Significant 


Length of time in the school of the surveyed teacher is positively related with students doing better in schools 
where the teacher has been for over 10 years, though the strength of this relation is reduced by allowing for the key 


background factors of the students. It may be that teachers find schools with a higher socio-economic intake more 
congenial and consequently stay there longer. 


Table 10.13: Regression results - Employment status 


Variables 


Without key variables 
With key variables 


*Significant if P<.05, **Significant if P«.01, NS-Not Significant 
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Conversely, students do not achieve as well in schools where the surveyed teacher is a temporary or para teacher 


and these relationships remain statistically significant and fairly sizeable after allowing for key student background 
factors. Para and shiksha karmi teachers are often a part of a programme to reach children in remote rural areas. 


10.11 Teaching Practices 


Teachers were also asked about how they taught. The majority gave regular homework and kept a teacher's diary. 
Only the latter showed a statistically significant association with the attainment of the students at their school. 


Without key variables 


With key variables 


“Significant if P<.05, **Significant if P<.01, NS-Not Significant 


Without key variables A: iis ES EE TEN 


With key variables 


“Significant if P<.05, **Significant if P«.01, NS-Not Significant 
Number of periods taught per week is not related to the attainment of the students in the study. 


It is likely that an enquiring attitude and enthusiasm for communicating knowledge will lead to increased contacts 


with other members of staff in the school. Teachers were asked about interacting with other teachers. 


Without key variables 
With key variables 


*Significant if P<.05, **Significant if P«.01, NS-Not Significant 


Over three quarters of the surveyed teachers were doing this regularly in one or more of these ways, but the attainment 


difference was not statistically significant. 
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The respondents were divided into two groups — those who, on an average, carried out all these activities at least once 


a week, and the rest. 


Without key variables 
With key variables 


*Significant if P<.05, **Significant if P<.01, NS-Not Significant 


There was no statistically significant relationship between this and attainment of the students in their schools on its 
own but there was a weak positive relationship with number of activities in the classroom after allowing for the key 
variables of socio-economic background and language spoken at home. 


10.12 Teaching Resources 


Having proper resources is an important adjunct of successful teaching. 


Teacher's handbook 
Teaching Learning 
Material (TLM) 
Audio-Video 
facilities 


"Significant if P<.05, **Significant if P«.01, NS-Not Significant 


Attainment in Language has a statistically significant positive relation with having a teacher’s handbook and audio- 
visual services, and these relationships are not substantially reduced by allowing for key background student variables. 
There is no statistically significant relation with the availability of TLM. 


Teachers were asked about the severity of some possible problems with the school facilities. Table 10.20 shows those 
where at least one of the problems was rated as ‘serious’. 


Without key variables EE 
With key variables 


*Significant if P<.05, **Significant if P<.01, NS-Not Significant 


Fewer than half reported having at least one as a serious problem. Students in these schools were less successful. This 
difference was not substantially affected by allowing for key background variables. 
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Without key variables 
With key variables 


*Significant if P<.05, **Significant if P<.01, NS-Not Significant 


Teachers were asked if they had got TLM grants for this year. Three quarters of respondents stated that they had, but 
this was related to slightly poorer performance by students. This relation was not substantially affected by allowing 
for key background variables. 


10 13 Attitudes and Views 
Attoudes of staff are also important. Perhaps most important is whether they feel the school is a safe place for them. 


These were combined to form an indicator of whether teachers find the school safe. Teachers were divided into two 


groups—those answering negatively to any of these questions, and the rest. 


thout key variables 
ith key variables 


*Sign/ icant if P<.05, **Significant if P«.01, NS-Not Significant 


Teachers considered their schools safe by a large majority, but this did not appear to be related to student attainment 
in a statistically significant degree. It is perhaps worrying that nearly one in five teachers felt that the school or its 


surroundings were not safe. 


Teachers were also asked to assess qualities of staff in the school. Teachers’ job satisfaction and expectations for student 
achievement had a statistically significant but small relationship with attainment in their school, but this became 
non-significant after allowing for key student variables. Teachers’ understanding of curriculum goals and teachers’ 
degree of success in implementing the curriculum did not have a statistically significant relation with attainment. 


Without key variables 
With key variables 


Without key variables 


With key variables 
"Significant if P<.05, **Significant if P<.01, NS-Not Significant 
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Table 10.25: Regression results - Teachers’ high degree of success in implementing the curriculum 


Without key variables — | t 
With key variables | 


*Significant if P«.05, **Significant if P<.01, NS-Not Significant 


Table 10.26: Regression results - Teachers’ high expectations for student achievement | 


With key variables | 
"Significant if P«.05, **Significant if P«.01, NS-Not Significant 


10.14 Conclusion 


Any conclusions from these results have to be extremely tentative because of the precarious nature of the link between 
teachers and students in this study as the teacher may not have been with the student concerned for more than on 

year. This also means that any relationships found may well be underestimates of their actual size. Statements abou: 
positive (negative) relationships between teacher aspects and student attainment should be interpreted to say that on 
an average, students in a school where the teachers were surveyed had a particular tendency to do better (less well). 
These comparisons are made first as a straightforward univariate comparison and then allowing for the key variable: 
of socio-economic status and home language. If a relation between a factor and an outcome is not extinguished b; 
making such allowances, it is reasonable to suggest that the factor is having an effect on the outcome. Inference 


will however be less reliable based on the teacher questionnaire because of the factors noted earlier in this paragraph. 


With these caveats, it can be noted that teachers personal characteristics (age, category) do not have a statistically 
significant relation with attainment, and nor does highest academic qualification. Gender (female) has a small 
positive correlation but this is not statistically significant after allowing for the key variables. 


There is a small positive relation with having a post graduate professional qualification, though this is no longe: 
statistically significant after allowing for the student key variables of socio-economic status and language spoken 


at home. Recent in-service training and participation in professional development do not appear to be related to 
attainment. 


Years of teaching experience does not have a statistically significant correlation with attainment, but years of teaching 
in that school does, though this relation is substantially decreased by allowing for key student variables. 


Students at schools with para teachers, shiksha karmi or comparable arrangements have lower attainment. This may 
be because such teachers are often a part of a programme to reach children in remote rural areas. Lower attainment 
also occurs where the teachers are temporary. This could be because they have not had time 


such appointments are an indication of problems in recruiting. 


to settle in, or because 


Giving homework regularly is not related to higher performance, though this finding disagrees with the analogous 
results from the student and school questionnaires. On balance, the other two results seem to be more credible for 


the reasons described above. Keeping a teacher's diary is positively related to attainment. Number of periods taught 


per week does not show a statistically significant relation with student attainment. Extent of interaction with other 
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teachers is also not related to student attainment, but engaging regularly in a wide range of Language activities has 


a (weak) positive relationship. 


Proper resources are an important contributor to successful teaching. Having a copy of the teachers” handbook 
and audio-video facilities are positively related to student attainment. However there is no statistically significant 
relation with having TLM. In schools where teachers reckoned that there were severe problems in some aspects of 
school facilities, attainment was lower. Performance was slightly lower in schools where the surveyed teacher reported 


having received a TLM grant that year. 


Teachers were also asked about attitudes and opinions. Most teachers considered their school to be safe. However, 


one-fifth of students in the sample were taught by teachers who did not feel that their school was entirely safe. The 
relation with student attainment was not statistically significant. Having a high degree of job satisfaction and high 
expectations for student achievement were slightly related to achievement, though these relations became non- 


statistically significant after allowing for student background factors. Surprisingly, teachers’ high understanding of 
curriculum goals and high degree of success in implementing the curriculum were not related to school attainment. 
It should be noted that these questions relate to a teacher's opinion of the staff in general, not necessarily to his or 


her own situation. 


‘The following factors appear to have a robust effect on attainment in Language, in the sense that the relationship is 


statistically significant and is not extinguished by allowing for other important variables including home resources 


and language of instruction spoken at home: 


m Years of teaching at the current school 
m Para teachers, shikshakbadh or shiksha karmi (negative) 


m Teachers diary 


m Range of activities in the classroom 

m Teachers handbook 

W Audio-Visual facilities 

m Severe problems with facilities (negative) 
m TIM grant (negative) 
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CHAPTER 11 EQUITY AND THE SUCCESS OF THE SARVA 
SHIKHSA ABHIYAN PROGRAMME IN PROVIDING 
EQUALITY OF OPPORTUNITY 


Sarva Shiksha Abhiyan (SSA), a flagship programme of the Government of India, provides a variety of inputs 
designed to ensure access, equity and quality in elementary education. This will not necessarily provide equality of 


attainment, since, as this report documents, there are factors which promote educational success other than those 
provided by official school-based inputs. Such factors include home resources and the relationship between the 
language spoken at home and the language of tuition. 

This chapter looks at the extent to which the programme has succeeded in providing equal school and school-related 
resources and facilities for all, regardless of background. This could be characterised as equality of opportunity or 
equity of treatment. To this end, we consider the qualities of the schools and teachers who are engaged in providing 
the education in them. Of course this can be only a partial snapshot, since it relates to the most recent year, not to 
the whole education career of the students in the study. However, this can give a picture of where the SSA project 
has arrived at most recently, if not during the entire career of the students. Similarly, the teachers in the study, in 

many cases, will have taught the students for the most recent year, and indeed some of them may not have taught the 

students concerned at all. We are however able to get a picture of the current state of the schools at which the study 

pupils are attending. Another caveat is also relevant: these results apply only to government and government-aided 

schools. As discussed earlier, a proportion of pupils attend private schools, and these proportions vary from state to 


stare. Not all such private schools will have superior facilities, however. 


We |» vestigate the success of the project in building on existing circumstances in providing equity by comparing 
the | ilities to two particularly disadvantaged groups with more favoured groups. As is well known throughout the 
worl, young people from houses with low socio-economic resources do less well, on average, than those in better- 
off homes. This project therefore compares the educational experience, as identified by this study, of the students 
identified as in the lowest fifth of the socio-economic index, with the rests of the population. The groups in the 


lowest fifth are designated as disadvantaged for the purposes of this chapter. 


‘The second comparison has a particularly Indian reference. Chapter 2 showed that students in the three scheduled 
groups — SC, ST and OBC- were substantially less successful in Language than those in the General or Other group, 
and chapters 4 and 6 showed the same pattern in Mathematics and EVS. Of the three scheduled groups, the least 
successful was the ST group. The second set of analyses described in this chapter therefore compare the education 


circumstances of the ST group with those of the General or Other group. 


A selection of educational circumstances is compared between the less favoured groups and the comparison groups. 
The circumstances to be compared come from the school and teacher questionnaires, and comprise ones discovered 
to be related to outcomes in this study, and some other ones which would generally be considered important when 
the topic is discussed. They are grouped into four categories, namely Physical Resources, Characteristics of Teachers, 
Atmosphere and Ethos of School Attended, and School-related Home Behaviour. 


Physical Resources 
1. Well-resourced: Schools are divided into well-resourced (20 or more of the 26 resources asked about in the 


study), and those less well-resourced. 
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2. High student-teacher ratio: Schools are divided into those with a student-teacher ratio of 40 or less, and over 


40. 

School has a computer (Yes/No). 

Ratio of students to computer less than 2.0 vs the rest. 

Days in school year 200 or more vs those which for whatever reason were unable to manage this. 
School has a Science lab (Yes/No). 

School has a member of staff to help with Science experiments. 

School has official SSA textbooks in all three subjects (Language, Mathematics and EVS). 
School has official SSA workbooks in all three subjects. 

10. School has official SSA handbooks in all three subjects . 


«B. oo. Sd Gy Wi ie S5 


11. School has teaching and learning materials in all three subjects. 
Qualities of Teaching Staff 


This combines formal qualifications and experience. 


1. Tt is generally accepted that it is important that teachers should have undergone a formal training. This variable 
compares the proportions with Graduate qualifications in the groups. 


2. Formal qualifications are not the only consideration. It is often considered that teachers need to have a degree 
of practical experience to be able to utilise their full potential. The variable identified those with more than five 
years experience. 


Age also goes with experience, and often authority. We compare the proportions of teachers aged over 50. 


4. Stability of staff is important. We compare the proportions of teachers who have been for over five years in their 
current school. l 


5. Classroom practice is important so we compare the proportions who keep a teacher's diary | 


6. We also compare the proportions who report using the teacher's handbook 


7. State that they give regular homework. It is not enough of course just to give homework. It is important to 


ensure that it is done and checked. (Pupils’ reports of homework given and checked are described separately | 
below under home-school interaction.) 


School Atmosphere and Ethos 


It is not sufficient to have good facilities and well-qualified staff, though obviously this will be very important. It is 
important that the school atmosphere and general ethos both of students and teachers are positive. 


1. Unpleasant experiences: Students were asked about a number of unpleasant experiences at school, namely, 
something of yours was stolen; you were hit or hurt by other pupils; you were made to do things that you did 


not want to; you were called by names; you were left out. This variable compares the number of these unpleasant 
experiences that students reported. 


Problem behaviour: School principals were asked about problem behaviours amongst students, specifically, 
arriving late at school; absenteeism; skipping class; violating dress code; classroom disturbance; cheating; 
profanity; vandalism; theft; intimidation/verbal abuse of other students; physical injury to other students; 
intimidation/verbal abuse of teachers/staff; physical injury to other teachers. If the school encountered any of 
these once a week or more, it was considered to have problem behaviours among students. 
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3. Feel safe: Teachers were asked about their perception of school safety, whether the school was located in a safe 
neighborhood, whether they felt safe at the school, and whether the school’s security policies and practices were 
sufficient. If they were happy with all of these, then the school was described as having teachers who felt safe. 

4. Difficulty recruiting. This was where a school reported that it was very difficult to fill vacancies. 

5. Understanding curriculum. Respondents to the teacher questionnaire reported that teachers’ understanding of 
che curricular goals was high or very high. 

6. Success implementing curriculum. Respondents to the teacher questionnaire reported that teachers’ degree of 

iccess in implementing the curriculum was high or very high. 

Home-—School Interaction 

If senteeism. Elsewhere in this report, it was found that the proportion of pupils being absent for a substantial 

portion of the previous month was rather high. For whatever reason, illness or simply non-attendance, this 
likely to affect attendance, and this was confirmed in chapter 8 of this report. This variable looked at the 
»portion of students absent from school for one week or more in the previous month. 

2. »mework every day. In chapter 8 it was found that giving homework every day was related to attainment in 

inguage. 

3. Homework checked at home. This was found to be related to attainment in Language, but not after allowing for 

her home circumstances. 

4. Homework checked at school. There was little variation in this as vast majority of pupils reported that their 

;mework was checked in school, but such variation as there was certainly related to attainment. 

1! Investigating Disadvantage: Findings 

Tables 11.1 to 11.5 compare the proportion of the disadvantaged group of students (defined as those coming from 

the lowest fifth of the socio-economic index) falling in a particular category with the corresponding proportion for 

the rest (i.e., more advantaged students). In an equitable situation, the proportions for the two groups will not be 
significantly different. 


Table 11.1: School facilities | 


Pupils per computer (Less than 2) 


School has computer 


200 days per year 


Science laboratory 


Help with Experiments 
Problems with facilities 


SE is the standard error associated with the measured proportion for the group. 
** P<.01 and * P< .05 
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Table 11.2: Teachers 


Give regular homework 


** P«.01 and * P< .05 


Characteristic 
Unpleasant experiences 1.27 


| se | 
| om | 
[Problem behaviour" | os | om | 
[edu E a — | o. | 
| 00m | 
| 0.09 


Difficulty in recruiting 
Understanding curriculum 


Success in implementing curriculum 


hence the reported value is a number not a proportion. 
** p<.01 and * P< .05 


Table 11.4: Home-School Interaction 3 


| Characteristic — [ — met | 
Absent for 1 week or more 


Homework every day 
Homework checked at home 
Homework checked in school 


** P<.OT and * P< .05 


11.2 Summary of Findings 


Facilities 


Table 11.1 compares the ‘disadvantaged’ group (the lowest fifth on the socio-economic index) with the remainder 
of the population on a range of school physical resources, It can be seen that there still is a gap in provision of 
school resources between the two groups and provision, or lack of it, seems to reinforce socio-economic inequalities. 
Students from a disadvantaged background are less likely to be in schools which: 


m Are well-resourced 
m Have a computer 


m Have a Science lab 
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m Have assistance with Science experiments 
m Textbooks in all three subjects 


m Handbooks in all three subjects 


They are also less likely to be in schools which have had fewer than 200 days per year. If this result is reliable, it may 
be that teachers in this type of school are working harder to compensate for the other disadvantages, but it is difficult 


to interpret without knowing more of the background. 
The is no detectible difference on schools having: 

L sh number of students per teacher 

E er than 2 pupils per computer 

" ous problems with facilities 


u «kbooks in all three subjects 


L| ching and learning materials 
Teachers 
The no detectible difference in teacher qualifications or experience, but teachers of the disadvantaged group are 


more ‘kely to report that they ‘give regular homework’. 
Atm phere and Ethos 


The. is only one difference in atmosphere and experience, namely that disadvantaged students are less likely to 


repon having had unpleasant experiences in school. 
How:e—School Interaction 


Pup» from disadvantaged homes are more likely to: 
WB  xhibit absenteeism 


m Have homework every day 


And less likely to: 


B Have their homework checked at home. 


There is a small difference on having homework checked in school, but only in the third decimal place. 


11.3 Scheduled Tribes 


Tables 11.5 to 11.8 show the results of comparing the students in the ST category with those in General or Other 


group. 
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Table 11.5: School facilities 


[Gharacteristic [ote [ se | 
[Wellresoureed ë [aa o] o | ow | 
A ES o | 

| om | 


Pops per computers an) | ost 
shoo as computer [m] 
CT S a 
scene taboto — [M3 | 
[Herp with periments | oe | 
[Teavoosinatsujes | oss | om | 
[Wonbooisinalsubeas — [08 [99 |. 

Teaching and teaming materal inan subjeas | og | om 


** p<.01 and * P< .05 


Table 11.6: Teachers 


(— e ther | 

mpesamegeteme | o | 

Problem behaviour | oe | 

Fe o 

Dmawnmu | 95 | ow | 000 — 
[o [cn wm 


Understanding curriculum 


Success in implementing cuestan | 08 | om | os | ow 
Unpleasant experiences 0.89 | MS | ; 


** p«.0t and * P< .05 


Table 11.7: Atmosphere and Ethos 


** P«.01 and * P< .05 


Table 11.8: Home-School interaction 


** p<.01 and * P< .05 
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11.4 Summary of Findings 


Resources 


The picture is less clear cut for the comparison between STs and the General or Other category. ST students are less 


likely to be in schools which: 


m Are well-resourced 

m Have a Science lab 

m Have help with experiments 

m Have serious problems with facilities 
m Have all three workbooks 

m Have teaching and learning materials 


However, they are also less likely to be in schools which: 
a ave student:teacher ratio over 40 
m Have more than 2 pupils/computer 


= Be open less than 200 days/year 


They are more likely to have: 


u ! three workbooks 
Teachers 


Teachers in the schools where ST students attend are less experienced, younger and less likely to be full time regular 
teachers. They are less likely to keep a teacher's diary or to claim that they give regular homework. 


Atmosphere and Ethos 


ST students are more likely to have had unpleasant experiences at school and less likely to feel safe. There is no 
detectible difference in misbehaviour and difficulties in recruiting. They are less likely to feel that teachers in their 


schools: 
m Understand the goals of the curriculum 


m Be successful in implementing the curriculum 


Home/School 


ST pupils are less likely to have homework every day, or to have it checked at home. There is no detectible difference 


in absenteeism or in having their homework checked at school. 


167 


References 


REFERENCES 


Avtar Singh et al., (2006). Learning Achievement of Class V Children - A Baseline Study, NCERT. 

Avtar Singh et al., (2007). Learning Achievement of Class III Children - A Baseline Study, NCERT. 

Avtar Singh et al., (2008). Learning Achievement of Class V Children - A Mid Term Study, NCERT. 

Avtar Singh et al., (2008). Learning Achievement of Class III Children - A Mid Term Study, NCERT. 

Andrich, D. (1988). Rasch Models for Measurement. Newbury Park, CA, Sage. 

Beat A.E. (ed) (1987). Implementing the new design: The NAEP 1983-84 technical report. Princeton, NJ: 

Educational Testing Service, National Assessment of Educational Progress. 

Foy, P & Olson, J.F. (2009). TIMSS 2007 user guide for the international database. Chestnut Hill, MA: TIMSS & 
RLS International Study Center, Boston College. 

Foy, P, Galia, F 82 Isac, L. (2008). Scaling the Data from the TIMSS 2007 Mathematics and Science Assessments. 
hapter 11 in Olsen et al (eds.) TIMSS 2007 Technical Report. 

Foy, P. 82 Olson, J. E (2009). TIMSS 2007 User Guide for the International Database. Chestnut Hill, MA: Boston 
llege. 

Hambleton, R. & Swaminathan, H (1985). Jtem Response Theory: principles and applications. Boston: Kluwer- 
ijhoff. 

Foxman, D., Hutchison, D. & Bloomfield B. (1991). The APU Experience. HMSO. 

Leeson, H. and Fletcher, R. (n.d.) An Investigation of Fit: Comparison of the 1-, 2-, 3-Parameter IRT Models to the 
oject as TTle Data. Unpublished working paper. Massey University, Albany Campus New Zealand. 

Olson, J. E, Martin, M. O. and Mullis, I. V. S (2009). TIMSS 2007 Technical Report (revised 2009). Boston: TIMSS 

PIRLS International Study Center, Lynch School of Education, Boston College. 
Thissen, D. & Wainer, H. (2001). Zest Scoring. Mahwah, New Jersey: Lawrence Erlbaum Associates. 


Zimowski, M., Muraki, E., Mislevy, R. & Bock, D. (1996). BILOG-MG (Computer programme). Available from 
Scientific Software International, Inc. 7383 N. Lincoln Avenue, Suite 100 Lincolnwood, IL 60712-1747 USA. 


171 


Appendices 


National Achievement Survey 


Appendix -I 


Sample Design and Procedures 


This appendik to the class V National Achievement Survey (NAS) report explains the sample design and the sampling 
methods of the survey. It describes the target and sample populations and the sample selection procedures. It sets 
out the necessary exceptions and their impact on the achieved sample. It also discusses sample weights and sample 
variance estimation within the survey. 


Cla». V (NAS) Target Population 


Th s V (NAS) was designed to investigate learning achievement in the government system at the level of the 
stat union territory (UT). Hence, the target population was all class V children studying in government and 
government-aided schools. Sample schools included those managed by the Department of Education, Tribal/Social 
We Departments and local bodies as well as private-but-government-aided schools. This follows the classification 
catecories of the District Information System for Education (DISE). Completely private schools were not included 
in this survey. Zila Parishad (ZPH) is a local government body at the district level in India. It looks after the 
administration of the rural area of the district and its office is located at the district headquarters. ZPH translates to 


District Council. These schools are established, supervised and funded by the ZPH district level authorities. ZPH 
schools provide education for students from grades 6-10 of the Secondary School Certificate. Schools run by the 
central, state or local governments are referred to as ‘government schools. Schools run by private managements but 


funded largely by government grant-in-aid are known as private aided or just ‘aided’ schools. 


The survey was available to all 35 states and UTs. However, Arunachal Pradesh, Dadra Nagar Haveli and Lakshadweep 
coul- not participate. Manipur participated in the survey's administration but faced problems in data collection and 
faile to report its data on time. Among the 31 participating states and UTs, six states - Jharkhand, Meghalaya, 
Mizoram, Nagaland, Sikkim and West Bengal - could not test class V students at the end of their school year and 
so decided to test class VI children at the beginning of the next school year. For the states which tested class VI 
students instead of class V students, the sampling rules described here do not apply. The coverage in these states was 


considered adequate, bearing in mind, however, that the target sample was not exactly as defined in the remaining 


population. 


Population Exclusions 


As is the case in other large-scale educational surveys, some sub-populations were excluded from the total target 
population at the initial stage of sampling. For logistical reasons, the class V (NAS) excluded schools with fewer than 
nine or, in some cases, five students depending on the enrolment characteristics of the state/UT. In addition to this 


‘small school exclusion’, the survey excluded “Upper Primary Only’ schools due to a classification error. 


As a result of these exclusions, population coverage of the class V sample varied from 99% in Tripura down to 7% 
in Assam. In five states/UTs - Assam, Daman & Diu, Goa, Kerala and Maharashtra - the population coverage fell 
below 80%, mainly due to the exclusion of Upper Primary Only schools. Table A-1.1 shows population coverage of 


the class V (NAS) sample after the sub-population exclusions. 
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Table A-1.1: Effect of sub-population exclusions on population coverage in states and UTs where Class V students 
were tested (data from DISE 2007-8) 


State or Union Territory Target Criteria of Class V Population | Population 
population | small school in Upper | size after all | coverage 
size exclusion Primary | exclusions | (percer: | 
= 


[AaNisands 6 [Emomemes| | 
[sina | meme | tnoment<a | 
[randia [mas [Emomemes[ TOE | 
Envoiment<9 | | ems | 
|Entolment<9 | [188360 | 

LONE 

KENAN 

Kn 

Pa 


Coverage 80% or 
greater 


| 6185 | 


vaca Pace wn [mmmees| — | 
Dep — — [258r ments | 
wm [emm [ewone] te | 
[pucung [a kain |] 
wj [asoma [mwmees| — 
[uma — ser [mmmexeo| — | ves 
Fama — [358m [twmees| — | sin | 
Dum —— . mss memmes| — | ses | 
Peer] 
hp 


8,45,998 | Enrolment « 9 8,12,042 
2,63,773 | Enrolment < 9 2,48, 801 


Uttar Pradesh 30,63,248 | Enrolment < 9 30,08,197 
Uttarakhand Enrolment < 5 1,23,251 


Coverage less than 
80% 


MEA 
[am [irasan | tmoimentes | 
C 
pe 77 3077703 


Sample Design and Selection 


pou 


In general, developing the sample for each state/UT involved a th ree-stage cluster design which used a combination of 
two probability sampling methods, Probability Proportional to Size (PPS) sampling and Simple Random Sampling 


(SRS). In SRS, all sampling units have an equal probability of being selected. When PPS is applied, larger sampling 
units have a higher probability of selection than smaller units. 


At the first stage of sampling, districts were selected using PPS sampling principles. This means that the probability 
of selecting a particular district depended on the number of class V students enrolled in that district. The number 
of districts to be selected from a state/UT was determined using an adaptation of the Finite Population Correction 
(FPC) formula in which it was assumed that a sample of twenty districts was sufficient for representing an infinite 


population of districts. Hence, the following formula was used to calculate the number of sample districts from cach 
state: 
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n= n/(1 +n/N) 


where 

n= number of districts to be sampled from ith state/UT; 

n, = number of districts required to represent infinite population of districts (taken as 20); 

N, = number of districts in i^ state/ UT. 

Ar the second stage, in the chosen districts, the requisite number of schools was selected using the PPS principles. 
The measure of size was based on class V enrolment data from the District Information System for Education 
(DIS +) 2007/08. Within selected districts, schools were sorted according to this measure of size to give an implicit 
straci cation before taking a systematic sample. (In Goa and some north eastern states, the PPS approach was not 
api due to administrative error and/or discrepancies between the sampling frame data and the reality in the 
fiel he number of schools to be sampled from a district was determined by the total number of students required 
for « ing and the average class size within the state/ UT. The number of selected schools for each district varied 
bet : 20 and 60. One replacement school was assigned for each sample school. Twice as many schools as required 
werc selected in pairs, with one of each pair being selected and the other being utilised as a reserve, in case it was not 
po co collect data from the original. 

The ass V (NAS) covered three subjects: Language, Mathematics and Environmental Studies (EVS). In most schools, 
twe the three subjects were assigned for testing. However, in Mizoram, Nagaland, Chandigarh, Pudducherry, 


Daman & Diu, and Andaman & Nicobar Islands students were tested in all three subjects. 


At the third stage, the required number of students in each school was selected using SRS. In schools where class 
V ha | multiple sections, an extra stage of selection was added with one section being sampled at random. A lottery 
met! od was used to choose a section and students in a sample school. The maximum number of students to be tested 
from + school was set as 36 with exceptions in several UTs. In the absence of prior information on the magnitude of 
desion effects, the project followed the effective practice of international studies and aimed for a sample with a target 


size in the neighbourhood of 4.000 except for the smallest states. 


Once students were selected, they were tested in the assigned subjects of their schools. Three different test forms 
of each subject were evenly distributed among selected students. Table A-1.2 summarises the criteria applied to the 
sampling of the survey by state. One aspect of this table may come as something of a surprise to readers not familiar 
with the details of sampling theory. The precision of a statistic from a sample is a function of the size of the sample 
and is essentially independent of the size of the population from which it comes. So, from tables A-1.1 and A-1.2, 
it can be seen that the size of the target samples from Uttar Pradesh (school Year V population 30,63,248) and 


Himachal Pradesh (school Year V population 1,07,540) are comparable, despite the wide range in population sizes. 


Table A-1.2: Sampling criteria by state 


State or Union Territory | Total number | Number of | Average Numberof | Estimated total | Maximum number 


sampled | schools to be number of of students per 
dasssize | selected per | students to be school to be 
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Sampling Frame, Sample Weights and Sample Variance Estimation 


In the survey, the PPS sampling method for districts and schools was based on class V enrolment data from th 
DISE 2007/08. Simple random sampling was conducted according to the class registers available in selected school: 
Although the DISE data was not free from criticism, it was used because it was considered to be the most complet: 
and up to date enrolment data available at the time of sampling. Unfortunately, due to discrepancies in the DISE 
data, limitations in the sampling method and loss of information at the sampling and administration stages of th: 
survey, it was impossible to estimate sample weights for the survey. Therefore, student responses of class V (NAS 
data were equally weighted within their state/UT data and each state/UT carried equal weight as a reporting unit. 
Because of the arrangements for replacing non-co-operating schools with an equivalent (see above), it is considered 
that response rates at the school level are essentially satisfactory, though no dara is available on this. Unfortunately 
no data is available for non-response within selected schools. 


Class V (NAS) adopted systematic probability sampling techniques and matrix sampling methods to improve its cost- 
effectiveness and to reduce the burden on students of responding to a long test. However, improving the efficiency 
of the survey came at a cost of some variance or uncertainty in the analysis. In order to quantify this uncertainty, the 
survey estimated the standard errors due to sampling for all reported statistics. Various techniques were explored. 


For the key statistical indicators, a replication procedure (jack-knife method) was used to estimate standard errors. 


Aggregation of results 


There is no completely satisfactory resolution to the question of how to aggregate data from this study. The project's 
approach to analyses was to include all data weighted equally no matter from which state it originated. In practice, 
this meant a slightly different practice for overall scores as well as for comparisons between population subgroups. In 
the overall state scores (Chapters 2, 4, and 6), results were reported separately for states with over 8096 coverage and 
those with below 8096. States which tested in school Year VI formed a separate reporting group. 
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It was considered that the 80% threshold meant that state results were sufficiently robust to compare with each other. 
The overall results reported for this group were simply the results for the aggregate of the pupils in the analyses. It is 
important to note that such results are not the average for the pupils nationally since states with larger populations 
are not weighted more highly, as they would be, for a national or group pupil average. Overall mean results reported 
are a close approximation to a ‘state’ average where each state's performance is weighted equally. In contrast, overall 
results from ‘below 80% states’ were not considered sufficiently robust to compare with each other or with the ‘over 


80%’ states. 


Analyses comparing results within states were not partitioned into the three groups according to coverage, since all 
results within a state would have been selected according to the same sampling procedure and, thus, closer to being 


equivalent. This also applies to subgroup comparisons, such as between genders or categories. 


Design Effects 


The design of the sample, whereby schools were sampled, and then pupils within the sampled schools, rather than a 
simple random sample, meant considerable advantages in terms of convenience of administration and in efficiency 
of use of school time. Conversely, it meant that it reduced the precision of results in comparison with a simple 
random sample. The impact of sampling clusters rather than individual students is known as the design effect, and 
can be of considerable use in planning future surveys with a similar design. One commonly used measure of the 


design effect is the statistic ‘rho’ defined below. 


Use capital E in estimated variance of achieved sample 


estimated variance of achieved sample 


Estimated variance of a simple random sample of the same size 


The design effect for the three subjects tested in the class V NAS calculated from the survey data is shown in Table 


A-1.5 below. 


Subject outcome 
e — DN. 


These results mean that, for example, the variance of the estimate of the mean language score is over six times as 


large as that of a simple random sample of pupils of the same size, and that to give the same degree of precision, 


the sample would need to be over six times as large for estimating the mean of the Language score, and over eight 
athematics and EVS. The last column, labelled sqrt_deff, shows the ratio of the standard errors; 


times as large for M 
guage for the achieved design would be two and a half times as large as that for a 


thus, the standard error for Lan 


comparable simple random sample. 
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Scaling the NAS data and estimating sampling variance 


IRT scaling of the NAS data 


The aim of the NAS 2010 survey was to achieve an assessment of a wide coverage of the class V curricula i 
Mathematics, EVS and Language. This meant that a relatively large number of items was required to cover t 
curriculum adequately. Thus, there were a total of 80 items in Mathematics and EVS while there were 50 item: 
Language. Since the number of items in each subject was far too many to present in a single test booklet, a comp! 
matrix-sampling booklet design was adopted with individual students responding to a subset of the items in : 
assessment and not the entire assessment item pool. This meant that the entire set of items was taken - but no: 
any single student. The sample design is described in more detail in Appendix - 1. 


The survey used Item Response Theory (IRT) scaling to describe student achievement on the assessment. Th 
allowed comparable achievement scores to be calculated for each student, even though individuals responded 
different parts of the item pool. 


A total of nine assessment booklets were prepared, three for each subject, covering the entire set of items and linke 
to each other by a set of ‘anchor’ items which were included in all three booklets for any subject. An example is giv: 
in Figure A-2.1 below. This is for Mathematics, but the design is the same for EVS and very similar for Language 


© new items 


(o) 


@ new items 


new items 


Form 1 (75 min) Form 2 (75 min) Form 3 (75 min) 


This chapter reviews the psychometric models used in scaling the 2010 class V (NAS) data. The project used the 
commercially available software BILOG-MG 3 (Zimowski, Muraki, Mislevy and Bock, 1996) in order to apply IRT 


models. 


00000000 


The IRT scaling approach used here is similar to that used in the international survey Trends in Mathematics and 
Science Study (TIMSS). This was originally developed in the US by the Educational Testing Service (ETS) for use in 
the National Assessment of Educational Progress (NAEP) and in the UK by the National Foundation for Educational 
Research for the Assessment of Performance Unit (Beaton [ed.], 1987; Foxman, Hutchison and Bloomfield, 1993). 
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Three distinct IRT models, depending on item type and scoring procedure, are most generally used in the analysis of 
assessment data. These are the one-parameter, two-parameter and three-parameter logistic models. Each is a ‘latent 
variable’ model that describes the probability that a student will respond in a specific way to an item in terms of the 
students unobserved attainment level and various characteristics of the item. For a description of IRT scaling, see 
Hambleton and Swaminathan (1985), Thissen & Wainer (2001). 


One-parameter logistic model (1-PL model) 


The expression for P, the probability of the i” examinee, ability q, being successful on the j^ item, difficulty b, is 


penas 
| exp(0,-b,) 
*  1+exp@,—5,) 
1 
~ L+exp[-@, —5)] 
There is only one parameter for each item, namely the difficulty 6. The one parameter logistic model is mathematically 


equi alent to the Rasch model (Andrich, 1988). 


Two-parameter logistic model (2-PL model) 


The expression for P,, the probability of the 7^ examinee, ability q, being successful on the j^ item, difficulty 6, is 
given by (Thissen and Wainer, 2002). 


__expla,@,-5,)] 
7 1+expla,(0,—b,)] 
1 
~ 1+ exp[-a,@,—4,)] 


This is comparable to the 1-PL model with the addition of a scaling or slope parameter a, which varies between items. 


(This parameter is related to the item's power of discrimination across the ability scale.) 


Three-parameter logistic model (3-PL model) 


The expression for P the probability of the i” examinee, ability q, being successful on the j^ item, difficulty b, is given 
by (Thissen and Wainer, 2002). 


1+expla;(0, —b,)] 
1 
1+expl-a(0,-b,)] 


P, =c,+(1-c¢,) 


=c,+(1-c,) 


« € 
p : : : i te, or “pseudo-guessin: 
where a, isa scaling parameter which varies between items, and c, is the lower asymptote, p g g 


parameter, 


The 2-PL model was used to calibrate the test items. Under assumptions of the 2-PL model, the probability of a 
response to an item is modelled based on the examinee' ability, the item difficulty, and the item discrimination. 


While other models are available for calibrating the items, the 2-PL model was chosen over the 1-PL or Rasch Model 
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because upon inspection of the item characteristics, the item discriminations were not seen as comparable across 
the pool of items (an assumption of the Rasch model). The 2-PL was chosen over the 3-PL model because the 3-PL 
model has stricter assumptions over the other models and also has higher requirements with regards to sample size 
and coverage of the ability distribution in order to be able to obtain reliable estimates of all item parameters, in 
particular, the ‘guessing’ parameter. This results in unstable and often inestimable parameters for some of the test 
items. The 2-PL model offered a widely acceptable compromise between the lesser and more restrictive IRT models 


available. 


Using this approach, a separate scale was developed for each subject. The mean of each of these three scales 
set to 250 and the standard deviation to 50. For Mathematics and EVS, this meant that achieved scores rang 


approximately between 100 and 400, while the range for Language was slightly less. 


The joint probability of a particular response pattern across a set of items is given by: 


where P, is the probability of the ^ individual being successful on the j^ item. 


This likelihood function is maximised to estimate item parameters and these parameters, in turn, are used to sc 


observed student responses on the assessments. 


Item calibration for the class V (NAS) 2010 was conducted using the commercially-available BILOG softw: 
(Zimowski et al., 1996). All student samples were weighted so that each state contributed equally to the it 
calibration. 


Omitted and Not-Reached Responses 


The matrix-sampling design meant that each student only got the opportunity to see the items in the booklet wh: 
they were given. Items which were not included in the booklet taken were treated as ‘not presented’, i.e., they we: 
ignored in the analysis of the data. However, students could also fail to provide an answer to an item which was i 
their test booklet and which, in principle, they could have seen. There are various possible reasons for this: they could 
fail to make an attempt on an item by mistake because they didn't feel it was worth attempting or because they had 
given up or run out of time before reaching the end of the test. An item was considered ‘not reached’ when the item 


itself, all subsequent items and the item immediately preceding it were not answered. 


« n . , PU 

Such ‘not reached’ items were treated differently in estimating item parameters and student proficiency scores. In 
estimating the values of the item parameters, items in the assessment booklets that were considered not to have 
been reached by students were treated as if they had not been administered. Conversely, ‘not-reached’ items were 


considered as incorrect responses when student achievement scores were generated 
Item Fit 


The fit of the 2-PL model to the items was examined graphically and using a chi-squared fit index. This was done 
on a state by state basis. Items identified as problematic were investigated to see if there were any obvious faults and 


where possible, these were rectified. If it proved impossible to remedy the problems of an item, then that item was 
dropped from the scoring for the state concerned. 
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Reliability 
Reliability of the test score scales was estimated from the IRT scaling BILOG (Zimowski et al., 1996) runs. For 


simplicity and familiarity, the marginal reliability coefficient is quoted here, rather than showing test information 


graphs (Thissen and Wainer, 2001). This is given by 


Wher s? is the variance of the test score scale in the sample and s? is the mean error variance of scores, both available 
from BILOG output. The values estimated here are 0.83 for Language, 0.89 for Mathematics and 0.89 for EVS. 


Estimating Sampling Variance 


As described in Appendix Al, the NAS 2010 sampling design applied a stratified three stage cluster sampling 
technique in selecting pupils. This design was administratively convenient and caused minimal upheaval in schools. 
However, since pupils within a school generally are more similar to each other than they are to the population in 
general, this approach to sampling effectively provides less independent information than a simple random sample of 
the same size. This design effect means that standard errors cannot be accurately estimated using the usual formulae 


which are derived for use with simple random sample designs. 


The jackknife repeated replication technique (JRR) was used in the class V (NAS) 2010 to calculate standard errors 
because it is computationally straightforward and provides approximately unbiased estimates of the sampling errors 
of cans, totals and percentages. The procedure used follows the variation on the JRR technique used in TIMSS 
2007 (Foy, Galia and Isaac 2008). It assumes that the primary sampling units (PSUs) can be paired in a manner 
consistent with the sampling design, with each pair regarded as members of a pseudo-stratum for variance estimation 
purposes. When used in this way, the JRR technique appropriately accounts for the combined effect of the between- 
and-within-PSU contributions to the sampling variance. The general application of JRR entails systematically 
assigning pairs of schools to sampling zones. Then, one of the schools is selected at random to have its contribution 
doubled, whilst the other school in the pair has its contribution set to zero. This constructs a number of ‘pseudo- 
replicates’ of the original sample. The statistic of interest (e.g., the state’s mean achievement score) is computed once 
for the entire original sample, and once again for each jackknife ‘pseudo-replicate’ sample. The variation between the 
estimates for each of the jackknife replicate samples and the original sample estimate is the jackknife estimate of the 


sampling error of the statistic. 


To produce a jackknife estimate of the sampling variance of a statistic + for a state, the schools in that state were 
paired to produce up to 100 paired zones. One hundred jackknife replicate samples were then created. For the /^ 
zone, one of the two schools was selected at random and its weight was doubled, while at the same time, the weight 
of the other was set to zero. Weights in all other zones were left unchanged. 4(/,), which is the value of the statistic 
for the ^ replicate sample was then estimated. This process was repeated for all such strata. The jackknife sampling 


estimate for the sampling variance was then given by the following equation: 


Nd S- asye 


umber of sampling zones in the sample of the state under consideration, in this case 100. The 
term /(S) corresponds to the statistic of interest for the state computed with the overall sampling weights unchanged. 
These calculations were carried out using the IDB Analyser (Foy and Olson 2009), which automatically computes 
standard errors as described in this section. Some specially written Statistical Packages for the Social Sciences (SPSS) 


where H is the total n 


routines were also used. 
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Performance in Anchor Items 


PERFORMANCE IN LANGUAGE 
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Table A-3.2: Area wise average achievement on anchor items in Language 
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Table A-3.3: Gender wise average achievement on anchor items in Language 
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Table A-3.4: Social group wise average achievement on anchor items in Language 
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| Table A-3.5: Distribution of students on the basis of percent of score obtained on anchor items in Mathematics 
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Table A-3.6: Area wise average achievement on anchor items in Mathematics 
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PERFORMANCE IN ENVIRONMENTAL STUDIES 


| Table A-3.9: Distribution of students on the basis of percent of score obtained on anchor items in EVS 
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Table A-3.10: Area wise average achievement on anchor Items in EVS 


State or Union 
Territory 

A&N Islands 

Andhra Pradesh 
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Table A-3.11: Gender wise average achievement on anchor items in EVS 


State or Union Territory 
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Table A-3.12: Social groups wise average achievement on anchor items in EVS 


A & N Islands 
| Andhra Pradesh EE 
450 
Bihar 
415 
Chhattisgarh 
53 
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Jammu & 
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Orissa 
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Rajasthan 
Sikkim 
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| Kerala 


195 


_ 
2 


National Achievement Survey 


Appendix — IV 


Item description with percent correct 


Table A-4.1: Item description with percent correct in Reading Comprehension 
Mental processes Question description Percent correct 
Use information to identify the main theme and evaluate the title 32 
Identify relationship between a pronoun and the object! person 3 
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Use information in the text to identify the remedy of a problem 39 
Identify the causal relationship of two events 41 
Identify relationship between an abstract idea and a concrete phenomenon 40 
Grasp the relevant idea about the thinking of people from the text 40 
Use information from a notice to conclude timing of an event 39 
Identify the correct place name from those given in the notice lj 


Grasp ideas/interpret 
Grasp ideas/interpret 
Grasp ideas/interpret 
Locate 


=A a 
E 3 
= 2 
= S 
a. 
(D 
o 
2 
= 
2 
(D 
m 
n=] 
3 
(D 
2 


Use information from a table to determine the frequency of an event 

Identify relationship between an object and its characteristics 

Determine the sequence of activities in a process 

Use information in the story to identify the cause of an event 

Use information in the story to grasp the problem 

Use information in the story to determine the cause of an event 

Use information from the notice to derive the duration of an event 

Use information from a table to determine the frequency of an event 

Make complex inference about the quality of persons from their activities 

Use information in the text to make inference about the cause of an act 

Make complex inference about the effect of an activity on concerned persons 
Use information to draw a simple conclusion about the usefulness of an object 
Use information in the text to identify the ingredients of an object 

Use information in a table to identify the most frequent event 

Use information in the text to infer the cause of an event 

Recognise appropriate information about the action to be taken by a person 
Use information in a story to make a simple inference about the cause of an act 
Use information from a notice to make a simple inference about participation in a sport 
Use information in a story to make a simple inference about the cause of an act 


E 


Grasp ideas/interpret 
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Grasp ideas/interpret 
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Grasp ideas] interpret 
Locate 
Locate 


Recognise the text type as a notice from the format and the content 
Use information in a table to identify the time for a phenomenon 
Use information in a table to identify phenomena occurring at a particular time 
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Table A-4.3: Item description with percent correct in EVS 


Question description Percent correct 
Understand the phenomena of lunar eclipse 30 
Know the importance of forests in human life 34 
Establish the relationship between a measuring apparatus and the quantity of water 26 
Find the effect of exhaled air on a mirror 35 


Mental processes 
Applying 


Reasoning 
Applying 


Know the sources of energy and their by products 35 
Know the components of food / diet and their functions 40 
Understand the process of breathing 4 
Find out the least polluting fuel on the basis of their combustion 4 


Applying 
Applying 


Establish the relationship between wind strength and a flag's position 42 
Reasons out the importance of wild animals in the eco system ld 
Identify the stages of seed germination 4h 
Reasons out to find directions in the map 44 
Know about the neighbouring countries of India 45 
Know the edible part of a carrot 48 
Interpret the graph to find out heartbeats of the mouse 48 
Reasoning Explain the reason behind the construction of dams 49 | 
Reasoning Analyse the family tree and find solutions 50 | 
Applying Interpret the graph to find out the rainfall on Wednesday 50 
Reasoning Find out the trend of growth in a plant 51 
Applying Identify the location of Jim Corbett Park in the map 54 
Reasoning Understand the family tree and interpret the relationship 54 
Know the animal source of food 54 
Establish relationships on the basis of a family tree 57 
Know the sources of water and their usage 58 
Relate different types of clothes with their properties 60 
Applying Interpret the graph to identify the animal that has the lowest heartbeats. 
Applying Apply knowledge to find the direction in a map 

Knowing Know the suitable conditions for breeding of mosquitoes 

Reasoning Find out the solution for a patient when a doctor is not available 
Applying Compare the means of transportation that causes pollution 

Applying Interpret the graph to find out the day with the highest rainfall 

Know the national game of India 
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Know the properties of solutes and solvents 

Know the name of the disease spread by mosquitoes 
Classify the group of domestic animals 

Recognise birds on the basis of their features 
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Appendix — V 


Socioeconomic Index 


Home and circumstances are a crucial factor in the development of intellectual abilities. These can include personal 
haracteristics such as gender and geographical region and social labels such as caste that affect the way a young 
erson's abilities may progress. It is also true worldwide, that socioeconomic circumstances have a major effect on the 

cess of individuals in the education system (OECD, 2010). In this report, an Index of Socio-Economic situation 
ised extensively, especially where looking at the relation between background factors and the outcome. It is 


rived from a combination of such background factors and the means of construction is described in this Appendix. 


index of Parental Education 
ie categories collected for parental education (mother's or father’s) in NAS were 


Table A-5.1: Parental education 


| Level A TE 7| 0 MA] 
| illiterate (not able to read and write) ATAN MS UC GNESS 

Literate (no formal schooling, can read or write) BED A E ER 
| Primary | OR ee eer er 
| 'econdary ERES Moon ES 
| Higher Secondary p P RM A ades ou] 
| Degree and above Pn E OH RUM 
| Do not know 
| ot applicable pudor i A A 
| Missing mower OTT MULT DRIN 
F Total E VEA ES A 


How does one define equidistance of categories? Since the outcomes of the NAS studies are achievement scale scores, 


there is a case for defining this in terms of a linear or near-linear relation with one of the scale scores. One scale score, 


namely Language, is considered here in this process. 


; ; i 
Figure A-5.1 shows the means of Mathematics scale scores by the categories of Father's and Mother's education. 


Figure A-5.1: Parental education and Language score 
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Discounting the last three categories on the right which have all kinds of missing data, the score means increase 
monotonically as the category number increases. There is little difference in the outcome for Literate and Primary, 
so the linearity of the relationship can be improved by combining category 2 (Literate) with category 3 (Primary 
School). The proportion of missing values is small (in the neighbourhood of 10% in total), but it seems intuitively 
at least reasonable to combine ‘Don't Know’ with the largest category (Literate/ Primary) and put Not Applicable 
equal to No Education. As in PISA, the higher of the two parental education categories is then taken as the indicator 
of parental education. Figure A-5.2 shows the result of these manipulations by comparing mean scores for the «ix 


resulting categories. 


Figure A-5.2: Language score and higher parent education 
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There is little difference in the outcome for Literate and Primary and so these are combined as shown in Figure 4-5.5 


| Figure A-5.3: Language score and higher parent education ; 
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Index of Parental Occupation 


A similar process is undertaken for parental occupation. Table A-4.2 shows the total number in each category. 
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Table A-5.2: Parental occupation 
levi i ee 


7 tabourer/ servant! daily wagerl street vendor Lue x dM m 
Lg | x9. o e ee 

5% led or office worker Le | 2 E 
)keeper or businessman 
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1860 Lo 
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't know 1,459 
al valid 111,008 1,07,910 91.7 
sing 6,645 

Total | wes | 


ure A-5.4 shows the results for mean Language score against Father's and Mother's occupation. The result for male 


;'usewives is somewhat surprising in an Indian context, and these respondents have been grouped together with 


so 
pu 
& 
= 
w 


- Unemployed group. Among Father's occupation, the trend is monotonic for the non-missing categories, except 
for the Manager/ Professional category. In further analyses, these respondents have been grouped with the Teacher/ 
Professor category. The two missing categories have been grouped with the largest category (3=Agricultural labourer 
), to which they mostly correspond in any case in attainment. In the final combination, the parental occupation 


Cil.) 
whichever is higher, that of the father or the mother is taken, with the exception that the category Housewife is not 


included in this process. 


| Figure A-5.4: Mean student language score and parental occupation | 
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Figure A-5.5 shows the final result. This is not guite so linear as in the result for education, perhaps not surprisingly, 


but it is at least monotonic. 


| Figure A-5.5: Higher parent occupation and mean Language score à 
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The third element of the socio-economic index comes from the Number of Possessions index. As its title sugc- 
this is simply the number of possessions owned by the pupil's family, from a list in the pupil questionnaire. 15c« 
are: calculator, computer, study desk, dictionary, internet connection, daily newspaper and magazine. The cler: 
computer and internet connection are not included in the construction of this index as preliminary analyses h: 


shown them to be negatively related to attainment. 


The mean test score in Language is shown graphed against the number of possessions in Figure A-5.6. It shows tha 


the relationship between the two is very close to linear. 
Figure A-5.6: Language score and number of possessions 
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Response rates for the three variables Parental Education, Parental Occupation and Number of Possessions are 
shown in Table A-5.3 
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Table A-5.3: Response rates for constituent variables 


Dwewdehaln — [3h —— 
Parental occupation O o 
[Number ot possesions | o | 


These were already high, but in order to increase the coverage further, missing values on any of the three variables in 
turn were replaced by a prediction based on regression on the other two. 


ally a principal components analysis of the three variables was undertaken and the first principal component, 
ich accounted for approximately half of the total variation, was taken as the socioeconomic indicator. 


ote: A similar procedure was used to create the socio economic status for Mathematics and EVS. 
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Appendix — VI 


Variance Components 


the light of the results of the regression analyses already carried out, firstly with predictor variable taken singly, an 
then after including the ‘key’ variable, in this case, the socio-economic status and speaks the language of instructi 
at home. There are a very large number of possible candidate variables and in some instances, cognate variables hay 


been grouped together to form scales. 
The predictor variables have been grouped into categories, as follows: 


From Pupil questionnaire. 

Group 1. Home and personal characteristics 
Socio-economic scale 

Speak instruction language at home 

Gender 

Category 

Number of siblings 

Physically challenged 

Transport to school 

Absent in the last month 


Group 2. School-related home factors 
Use of school computer 

Use of school library 

Given homework 

Help with homework at home 

Child has a tutor 

Homework checked at home 
Homework checked at school 

Language textbook 

Learning oriented home activities 


Group 3 Non-school home factors 
Other out-of-school activities 
Domestic chores 


Group 4. Attitudes etc., 


Bad things happen at school 
Scale of language attitude items 
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Group 5. Teaching practices 
Reading activities in class 


"From school questionnaire 
Group 5. Resources. 
N umber of types of equipment 
Ratio pupils/computer 

ternet access 


nmunication technology help 


k of resources 


ficulty filling teacher vacancies 


oup 6. Structure 
iministration 
eschool attached 


'oportion male teachers 
roportion girls 
ayslyear 


ays/week 
ducation committee 
TA 

| Under SSA 


roup 7. Activities of the Principal 
dministration 


„croup 8. Accountability 

E equency of testing 
cacher evaluation 

| inspected 


| Group 9. School composition and pupil attitudes/behaviour. 
Pupil composition 


| Pupil behaviour problems 
Group 10. Parents 
Qualities of parents 
Group 11. Incentives 


Some incentive scheme in place 


Procedures for dealing with omitted data 


The large number of variables involved has led to problems in another way. Response rates for individual variables are 
high, typically in the region of 85-90%. However, after excluding cases on the standard list wise basis and attempting 
to include all the above variables as regression predictors, the effect on the sample size is extreme. Including all the 
‘pupil’ variables above reduces the effective sample size by nearly half, from 72,205 to 38,164 and including ‘school’ 
variables reduces sample size to 2,444, while including both, reduces it still further to 1,033. 
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For this reason, it was decided that some kind of non-response adjustment process was required. A regression 
approach was used. The procedure differed somewhat between ‘pupil’ and ‘school’ variables. ‘Pupil variables were 
predicted by regression from the other variables in the thematic group. Because of the extreme effect of non-response 
among the ‘school’ variables, the regression was carried out on the variables collected from pupils relating to their 
school. After running these regressions, missing values were imputed using the relevant regression predictions. After 
this procedure, even after including all relevant variables, the sample size was 58,875, i.e., over 80% of the original 
sample. 


Variance components: Language 


Table A-6.1 shows the contributions of the various variable groupings when introduced sequentially as a proportion 
of the total variation. 


| Table A-6.1: Language: contributions to variance | 


EA EA C 
Home and personal characteristics DEN < | 
School-related home inputs Baas 


| 
ates ofthe Pindpal — | 
[mnes — — ME 


Conclusions 


The first grouping (home and personal characteristics) accounts for more than half the total rather disappointing 
proportion of variance explained of 0.071, i.e., slightly over 7%. Other relatively large contributors are school-related 
home inputs, mainly homework-related), pupil attitudes, and school structure (e.g., governance and composition of 
staff and pupils). It is important to remember that an apparently small contribution does not necessarily mean that a 


given input area has relatively little impact; it could be that the items which it was possible to measure were not the 
most important aspect of the area. 
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Student Related Variables 


E: Table A-7.1: Gender wise distribution of students 
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| Table A-7.2: State wise highest level of education of either parents 


Illiterate Literate or Secondary! Degree & | Donotknow/ | Total (N) 
Primary Higher Secondary above Not Applicable 


ETUM 
3(0 


State or Union Territory 


"o1 
Andhra Pradesh 28 (1.3) 18 (1.4) 5 (0.6) 14,354 
5) 
) 


[sum | 909 10. 527 | 
feinar |) 4 (055) 3787 | 
Chandigarh 10 (13) 8 (1.5) TM 


Chhattisgarh 


19 (1.1) 3 (0.5) 2,517 


| 30) | A 
Daman & Diu 8 (3.1) 6 (1.8) 1,280 


| | 


2 ( 
3 (1 
26 ( 


.8) 
Himachal Pradesh 8 (1.0) 8 (1.0) Am 
ZI soa) [ aso 

3) 

) 


Jammu € Kashmir 
Jharkhand 
Karnataka 


n (0.9) 10 (1.3) ym 


z(t 505) | 500 

362 vos) [sam 

102 109) 4,164 

2 (1.6) 4 (0.8) 2,70 

E 10 | es | 

9 (05) na zon | 
30. E 


E 

3) 
ET 162) s0 | wn 
Gu TU) 109] 
anana 263 503 | 40 

6) : 

2) 

2) q 


Madhya Pradesh 
Maharashtra 
Meghalaya 


2 (0.5) 6 (0.7) 13 (1.3) 2,869 | 
Nagaland 15 (1.6) 7 (1.6) 1501 
503 sia) | 29e | 
Puducherry 26 ( | 
Punjab y 
Rajasthan 
Sikkim 
Tamil Nadu 


+ EA 
8 (0.6) 2 (0.3) 5/66 | 
160 roa) | ame 

209 | wie | xay | 3 (0.5) 4,646 
san [wia [win [365 | CE 
ros ati 
| 38(03) | | son | 


= 
as: 
5 
= 
= 


29 (1.4) 4 (0.5) 2(0.4) 3,459 | 


Uttar Pradesh 
Uttarakhand 


.6) 
168 sta) | ns 
naa [eta | at 205) | 389 | > 
! ues 
6) 
) 


e 

=| 
ojo 
an Mad 
— | 0 
NES 
mi 
sS 
E 

G 


2 


= 
oo 


Appendices 


Table A-7.3: Student's achievement in Language with relation to parents’ highest level of education 


Literate & Primary Secondary & Higher Degree & above 
Secondary 
Average Average Average Average 
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Table A-7.4: Students achievement in Mathematics with relation to parents’ highest level of education 


Territory 
achievement | Mean | achi 
Islands 
Andha Pradesh | ao] se | m |en] w [ws] se 9 | 
7] 
CTA SE Kw oum p om A [ox | 
5 26 | 
KE [ar | 19 | s | 


Umm — | m [as | 29 | 157] 
Pi a Ud 0 E VETO E 
LIONE GNU a ER 
Memamo | o5 [ae | | 

41 
| 


248 
272 
243 


247 


M mMiw|jwe|vw 
N 
ES 
o 
cus 
F 


N 

N 
— 
co 


210 


2 
"2 
"o 

[c] 

= 

a 

8 

& 


Table A-7.5: Students achievement in EVS related to parents’ highest level of education 


State or Union Illiterate literate & Primary Secondary & Higher Degree 
Territory Secondary 
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Table A-7.6: Availability of computers in schools 


State or Union 
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Appendix — VIII 


School Related Variables 


Table A-8.1: Comparison of school averages on the basis of school management | 
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Arriving late 
at School 


Cheating 
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Appendix - IX 


Teacher Related Variables 


State or Union 
Territory 
Andhra Pradesh 
“Assam 
jihar 
handigarh 
Chhattisgarh 
Daman & Diu 
| Delhi 
| Goa 
| Gujarat 
| Haryana 
| Himachal Pradesh 
Jammu & Kashmir 
"Jharkhand 
| Karnataka 
| Kerala 
| Madhya Pradesh 
| Maharashtra 
| Meghalaya 
| Mizoram 
| Nagaland 
Orissa 
Puducherry 
Punjab 
Rajasthan 
Sikkim 
Tamil Nadu 


Uttar Pradesh 


Uttarakhand 


West Bengal 
Overall average 


Table A-9.1: Distribution of teachers on the basis of age 
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51 years and above 
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Table A-9.2: Teacher's educational qualification 


State or Union Higher or Senior Post graduation 
Territory Secondary 
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Table A-9.3: Employment status of teachers 


| State or Union Regular full time Against leave Para teacher 
| Territory vacancy 
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Table A-9.4: Professional qualifications of teachers 


State or Union Territory Primary or elementary teaching Graduate Training B.Ed 
certificate or diploma 
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Table A-9.5: Agencies who provide in-service training 


Pee || oe 0 
complex 

| ww) | a | wG) | D | ET 

7209 

sees [ ssa | ase) | «9 | eee [eatin 

2903 502 

0 (0) 5.66.9 | 1862 


State or Union 
Territory 


2.8 (1.5) 
Assam 

Bihar 
Chandigarh 
Chhattisgarh 


> 
= 
a 
= 
E 
o 
=> 
= 
o 
a 
D 
wv 
=> 


Delhi 


o 
= 


a =] 
o 
= 
o 
5 
go 
2 
= 


I) Tm 
e [was | 76 | 00 [amen | 676) 
Himachal Pradesh | 40.8 (3.9) 10.2 (2.4) 
ir | $269 | asea | 258 | o | ow | 109 


0(0) 4.5 26) 
313 (65) 

16. ) (I. 

la E 


46.5 (63) 


3 | o9 | Em 
ZI, 06. 


) 
abn TE 
7963) T 
nia [ses | aaea | oo | ow [mea 


Karnataka 


Madhya Pradesh 
Maharashtra 
Meghalaya 
Mizoram 


"m 


57.2 (3.8) 
17.8 (3.1) 


= = ie z Ka) 
e s/o = e 
= = 13 IL E. 
o = SH ia 
— zia mia 
w EE = 
z 5 3|2 

3|% 

a E 

a 

a 

E 

3 

= 


= 

= Sg sz 
t^ [ga 

= 5 |S 

= 3 

a a 

[— 


6 
iG 6703 
303) i0 
TTE 520) 
a TIE 
Puducherry 523 (64) o0 
Pu 2.364) ZEE] 
Rajasthan 33.6 (4.1) w.8(18) | 2536.8 
sikkim 21.5 (4.1) 14.8.5) 1101) 

36. ) 

4 


TIT 1962) 
0 
) ( 


x65 50 uli 
363 2542 
209 5309 
CITY 2703 


Tripura 

Uttar Pradesh 
Uttarakhand 
West Bengal 
Overall average 


73) 1603 
36 (07) [308 [renea | 0300) | 47003) | EIN 


219 


National Achievement Survey 


Table A-9.6: Teachers giving homework 


State or Union Territory 
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l Table A-9.8: Status of Teacher's Handbook, TLM grant, TLM and audio-visual facilities 
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Appendix - X 


List of Surveyed States, Districts, Schools, Teachers, and Students 


No. of 

selected 

district 
[28 [AGNIslands | 2 


Andhra 
Pradesh 


State! Union 
Territory 


Middle And North Andamans, South Andamans 
Adilabad, Nizamabad, Karimnagar, Hyderabad, 
Mahbubnagar, Nalgonda, Warangal, Visakhapatnam, East 
Godavari, West Godavari, Anantapur 


Dhubri, Goalpara, Bongaigaon, Kamrup; Nalbari, Darang, 294 
Pashchim Champaran, Madhubani, DR Darbhanga, 224 420 
Muzaffarpur, Saran, Begusarai, Bhagalpur, Nalanda, Patna, 
Gaya, Nawada 
Chandigarh 
Furguja, Jashpur, Raigarh (Chhattisgarh), Janjgir - Champa, 
Bilaspur (Chhattisgarh), Rajnandgaon, Durg, Raipur, 
Mahasamund, Dhamtari, Baster 
Daman, Diu 


North West Delhi, North East Delhi, East Delhi, Central Delhi, B9 148 

West Delhi, South West Delhi, South Delhi 

North Goa, South Goa 
Kachchh, Banas Kantha, Patan, Mahesana, Sabar Kantha, 
Ahmedabad, Junagadh, Bhavnagar, Anand, Kheda, 
Bharuch 
Yamunanagar, Kurukshetra, Sonepat, Jind, Fatehabad, 
Sirsa, Hisar, Bhiwani, Jhajjar, Mahendragarh, Faridabad, 
Palwal 
Chamba, Kangra, Kullu, Mandi, Hamirpur, Una, Solan, 248 329 
Sirmaur, Shimla 


Kupwara, Baramulla, Pulwama, Anantnag, Doda, 
Udhampur, Punch, Rajauri Jammu, Leh (Ladakh) 
Hazaribag, Kodarma, Giridih, Deoghar, Sahibganj, Pakaur, 


Dhanbad, Bokaro, Ranchi, Pashchimi Singhbhum, Purbi 
Singhbhum 


Belgaum, Bijapur, Gulbarga, Raichur, Haveri, Bellary, Kolar, 
Bangalore, Mandya, Dakshina Kannada, Chamrajnagar 


250 
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Gujarat 


Haryana 4,889 


239 241 


pes 
Be 
Jammu and 
Kashmir 
Jharkhand 


Karnataka 


Kannur, Wayanad, Kozhikode, Malappuram, Palakkad, 
Thrissur, Ernakulam, Kollam 

Morena, Bhind, Gwalior, Guna, Tikamgarh, Sagar, 
RewaSidhi, Mandsaur, Ujjain, Jhabua, Betul, Hoshangabad, 
Narsimhapur 
Nandurbar, Nagpur, Jalna, Aurangabad (Maharashtra), 
Nashik, Thane, Pune, Ahmadnagar, Bid, Osmanabad, 
Solapur, Ratnagiri, Kolhapur, Yavatmal 


Madhya 
Pradesh 


Maharashtra 


pee 
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Mamit, Aizamel, Champhai, Lawngilai, Saiha 2,941 


E MON, TUENSANG, Mokokchung, Zunheboto, Wokha, 104 295 1,578 
Dimapur, Kohima, Phek at Meat kal 
Keonjhar, Mayurbhanj, Balasore, Bhadrak, Jagatsinghapur, 266 416 2,665 
ES Cuttack, Angul, Khordha, Ganjam, Bolangir, Kalahandi, 
Rayagada, Malkangiri 
Pondicherry, Karaikal 
EN Gurdaspur, Amritsar, Kapurthala, Jalandhar, Hoshiarpur, 251 261 3,963 
Nawanshahr, Ludhiana, Firozpur, Muktsar, Sangrur, Patiala ee 
Jodhpur, Barmer, Jalor, Pali, Bhilwara Rea Baa ia 
2 West Sikkim (Geyzing), East Sikkim, South Sikkim, North 133 263 3,343 
Tamil Nadu Chennai, Kanchipuram, Vellore, Thiruvannamalai, 230 324 5,836 
Vilappuram, Salem, Coimbatore, Tiruchirappalli, 
Ramanthapuram, Thoothukudi, Kanniyakumari 
Mir ee 
Tripura 


Uttar Pradesh Moradabad, Rampur, Meerut, Ghaziabad, Aligarh, Etah, 241 326 4,789 
Bareilly, Sitapur, Etawah, Kanpur Nagar, Allahabad, 
Bahraich, Basti, Kushinagar, Ballia, Varanasi 
Uttarakhand Chamoli, Tehri Garhwal, Dehradun, Garhwal, Pithoragarh, 
Almora, Champawat, Nainital, Haridwar 
E 


West Bengal Jalpaiguri Cooch Bihar, Murshidabad,Barddhaman, North 255 561 4,701 


Twenty Four Parganas, Hoogly, Purulia, Howrah, 
Kolkata,South Twenty Four Parganas, Paschim Medinipur 
ee ee ee Associate Coordinator 
Andhra Pradesh Director, SCERT, Hyderabad Dr. S. Vijay Kumar 
Andhra Pradesh SCERT, Hyderabad, Andhra Pradesh 
Director, SCERT Mr. Laxmikamt Das 
Gauhati, Assam SCERT, Assam 
Bihar Director, SCERT Dr. Syed Abdul Moin 
Mahendru, Patna, Bihar Head, Technical Education, SCERT, Bihar 
Chhattisgarh Director, SCERT, and State Project Officer, Rajiv Ms. Archana Verulkar 
Gandhi Shiksha Mission, Raipur SCERT, Sankar Nagar, Raipur, chhattisgarh 
Delhi Dr. V.P. Singh 
SPD, 
SPD Office Road, U.E Mission 
Director, SCERT Dr. Richard Kalbarl 
Panaji, Goa. SCERT, Goa 
Gujarat Director, GCERT Dr. Bhaumik Trivedi 
Gandhinagar, Gujarat GCERT 
9. Haryana Director SCERT, Dr. Yogesh Vasishtha 
Gurgaon, Haryana 


[ san | 10,851 | 117653 | 


SCERT, Gurgaon, Haryana 
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Jammu & Kashmir 


n. Jharkhand 


Pustak Bhawan, B-Wing, TBC 
Arera Hills, Bhopal 


Maharashtra Director, MSCERT 
708, Sadashiv Kumtekar Marg 
Pune-A11 030 
fus Secretary, Board of Secondary Education 


Mr. Shiv Kumar Sharma 
Sr. Lecturer, SIE, Himachal Pradesh 


Himachal Pradesh Principal, SIE 
Himachal Pradesh Primary Education Society, 
Shimla-171001 
Principal, State Institute of Education, Jammu. Mr. A.R. Bhatt, 

Principal, State Institute of Education, Srinagar | SIE, Srinagar 

Director, Elementary & Secondary Education, | Dr. Pramod Kumar Sinha 

HRD Jharkhand Education Project Council, Shyamali 
JEPC, New Cooperative Building Colony, Doranda, Ranchi 

Shyamli Colony, Ranchi-834002 
Director, DSERT 

No.8, KSCMF Building, MSB, 3rd Block, 2nd 
Floor 

Cunningham Road, Bangalore-560052 
Director, SCERT 
Thiruvananathapuram 
Kerala 
Director, State Education Centre 


Ms. A. Subhadra 

DSERT 

No.8, KSCMF Building, MSB, 3rd Block, 2nd Floor 
Cunningham Road, Bangalore-560052 

Mr. C. Gokul Dasan Pillai 

Head Curriculum , SCERT, Poojappura, 
Thiruvananthapuram, Kerela 

Mr. P.L. Dongre 

SCERT, Arera Hills, Bhopal-462021 


Madhya Pradesh 


Shri K.D. Panage 

MSCERT 

Pune, Maharashtra 

Mr. S. Mangi Singh 

Mr. S. Jitelal Sharma 

Under Secretary , Board of Secondary Education, 
Manipur T 
Mr. P.B. Lartang, 

Sr. Lecturer, DERT, Shillong 


Director 
Directorate of Educational Research and 
Training 

Shillong-793 011, Meghalaya 
Ms. Sangthanmawii 
Joint Director 


Ms. D. Ramdinthangi 
SCERT, Aizawal, Mizoram 


Manipur 
18. Meghalaya 
School Education & SCERT 
HE Director, SCERT Dr. Trllotama Senapapi, Assistant Director, SCERT, 
SCERT, Bhubaneshwar. 
Assistant Director, SCERT, Udaipur, 
Dr. (Mrs) Indira Joshi, Joint Director, SCERT, — | Mr. Suraj Bir Singh SCERT, Sikkim 
Sikkim 


EL. Aizawal, Mizoram 
EN Nagaland Director , SCERT Mr. Daniel Thong Seb 
Nagaland, Kohima Lecturer, SCERT, Kohima, Nagaland-797001. 
Bhubaneswar, Orissa Orissa 
Dr. Namita Chhotroy, Coordinator 
Director, SCERT Mr. Jagtar Singh 
Punjab, Chandigarh SCERT, Punjab, Chandigarh. 
23. Rajasthan Director, SCERT Mr. Aditya Mishra, 
Udaipur, Rajasthan 
Rajasthan. 
2s Tamil Nadu Dr. R. Elangovan, Dr. L. Radha 
Director, DTERT Asst. Professor, DTERT 
Tamil Nadu Chennai 
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Appendices 


SCERT, Agartala, Tripura. 

Mr. Sanjay Yadav 
Ms. Mamta Dubey 
SIE, Allahabad, U.P 
Dr. D.S Lingual 
SCERT, Narendra Nagar, Tehri Garhwal, 
Uttarakhand. 
Mr. Subrat Kumar Biswas 
Mr. Gautam Bhattacharya 
SCERT (WB), 25/3, Ballygunj Circular Rd., Kolkata, 
West Bengal. 
Dr. M. Ayyaraju, 
Assistant Director of Education (Monitoring), State 
Project Officer, SSA, Port Blair, Andaman & Nicobar 


Tripura Director, SCERT 
Agartala-799 005, Tripura 
Uttar Pradesh Principal, SIE, 
Allahabad, U.P 
Uttarakhand Director, SCERT, 
Tehri Garhwal, Uttarakhand 
West Bengal 


Andaman & Nicobar | Dr. R. Devdas, 
Islands Principal, SIE, Port Blair 
Islands. 


Andaman & Nicobar Islands 
31. Chandigarh Dr. S.S. Dahiya, Director, SIE Dr. Savita Sridhar 
ES 
32. Puducherry Director of School Education, Mr. R. Valavan 

Puducherry Principal, Dist. Institute of Education and Training, 
" Puducherry-605 008 Puducherry-605 008. 


Dr. R.N. De, Director, SCERT 
28/3, Ballygunj Circular Road, 
Kolkata -700019 (West Bengal) 
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WHAT ARE NATIONAL ACHIEVEMENT SURVEYS? 


National achievement surveys are large-scale assessment exercises designed to determine 
educational standards across the country. 


They use a representative sample of students and must be carefully designed to fit the group 
being assessed. 


National achievement surveys are not examinations. They check the general health of the 
education system: they don't test individual students! 


The main purposes of large-scale education assessments are: 


to measure typical levels of achievement — i.e. find out what students achieve in key 
subjects 3 


$ 


to make comparisons — e.g girls and boys, among states etc. 
to monitor trends over time — i.e. track progress 


to investigate background factors that may affect educational outcomes — 
e.g. home context and school environment. 


faga s ansa 


ea etti om ett 
NCW-RT 


ada AAs sgia site ufsreror uRus 
NATIONAL COUNCIL OF EDUCATIONAL RESEARCH AND TRAINING 


